Avoid making negative or unhelpful posts, and instead focus on providing constructive feedback and ideas that can help to move the discussion forward.
- Manlobbi
Stocks A to Z / Stocks B / Berkshire Hathaway (BRK.A)
No. of Recommendations: 26
Hi, folks.
The search tool for old Fool messages in the MI and some other boards is in trouble. It is the one found at
http://www.datahelper.com/mi/search.phtml. It is running on my server which is running VERY OLD Linux and written in VERY OLD PHP. Sort of like the cobbler's kids with no shoes, the dentist's kids with no teeth. Never time to take care of my own nest. It has come time to not upgrade it but replace it and try to get things running in modern style.
The search engine is going to be down for a while. I expect to rewrite it, leave the ugly ancient code behind. Really ancient. More than 20 years old. It isn't use a whole lot but it IS used. I'd want to get it running as soon as possible. I just don't know how soon that is.
If anyone wants to take over for me, I would be ecstatic. I am trying to retire. I could supply the database (about 2.5G) and the code to help you with the logic. If anyone wants to broaden its availability, that would be great. You could wait until I rewrite the sucker and take a copy then. Whatever.
I hope all is good, profitable, and interesting for you all!
Mark Willcox
No. of Recommendations: 24
I could just import those old posts into Shrewd知 so they would appear as ordinary posts here and also be searchable (by recs or by most recent, as the top-right search here already does).
When reading any posts I would add a disclaimer below every post stating that the post was originally published at The Morley Fool, and was not published at Shrewd知, provide a link to The Motley Fool and also say we are without affiliation, just to make that really clear whilst showing support/respect to The Motley Fool.
I壇 map the user aliases in an automatic way so that when reading a post, the author痴 Shrewdness-Star etc would only display if there was a case insensitive matching alias ar Shrewd知.
Mechanical Investing, Berkshire and Falling Knives.
- Manlobbi
No. of Recommendations: 2
That would be great!
We have 280,405 MI posts, 273,773 from Berk. No Falling Knives though.
No. of Recommendations: 1
I could just import those old posts into Shrewd知 so they would appear as ordinary posts here and also be searchable (by recs or by most recent, as the top-right search here already does).
Mark's data is searchable by author, subject and content. Is it possible to include this as searchable items?
No. of Recommendations: 14
FYI: I for one have used this tool extensively and am extremely grateful for all the work you've done with it over the years!
Zee
No. of Recommendations: 0
2.5GB... convert it to a no-code pile of content? I mean, AWS CloudSearch a target possibility? (Would require $xx / year contribution & billing...)
... wikidot? Free tier, searchable...
with those options there's no PHP code, at least nothing the next generation needs to maintain...
Not knowing the database structure...
FC
No. of Recommendations: 10
I could just import those old posts into Shrewd知...
This sounds great, but I am a HUGE fan of MarkW's search features and would like to find away to keep that interface running. (And, if possible, extend it to the Shrewdm posts seamlessly, but that is for bonus points)
I have a couple of thoughts on this, but I'm on the road for the next several days, perhaps I can pass on my thoughts off board next week when I get back to my cave?
Jim
No. of Recommendations: 3
I also use the search features of MarkW's excellent search engine frequently!
So simple, and quick, what else could you ask for?
Mark
No. of Recommendations: 18
If anyone wants to take over for me, I would be ecstatic.
We have 280,405 MI posts, 273,773 from Berk. No Falling Knives though.
Mark,
I will try to set something up. I have a csv file with 280,008 MI posts from 19980408 to 20220923 (about 0.5G). Access to the datahelper database (about 2.5G) and the code to help with the logic would be helpful. Thanks again for the many years of the excellent datahelper search.
Best Regards,
lizgdal
P.S. If anyone does not want their old MF posts to go live again on a new website, let me know. Or if someone is already doing this, let me know.
No. of Recommendations: 10
For the sake of the history of MI and ALL THAT COLLABORATIVE RESEARCH on the Bearcatchers and other intermediate term defensive signals, and before that the OG screen backtests... mechanical asset allocation methods... I desperately want to see the key archives resurrected - the threads and the posts linked to from
http://mechinvesting.wikidot.com/.
How about we set up a shared Google Drive, or upload to wikidot dirextly with the content of those old key posts, or extract the content of those posts into modernized files, or something. I'd help create copies and backup copies of those html message files of interest. Something! Not as technical as I used to be (
"though we are not the strength we used to be, that which we are we are" perhaps ;-)
FC
No. of Recommendations: 15
Mark,
I will try to set something up. I have a csv file with 280,008 MI posts from 19980408 to 20220923 (about 0.5G). Access to the datahelper database (about 2.5G) and the code to help with the logic would be helpful. Thanks again for the many years of the excellent datahelper search.FYI - Mark no longer follows the board, so he is unlikely to respond to your post.
Another frequent poster asked if I would contact Mark and see if he would be interested in updating the code as a paid gig. Long story short - Mark would be interested (as of 3/17/25)
I throw this out there as another option if you are pressed for time.
Also remember that Jamie (Griton) volunteered his server as a host. (
https://www.shrewdm.com/MB?pid=242093788)
I hope you have contacted him about getting access to the code and database as he offered in the OP. The poster I previously mentioned had emailed Mark with his offer, but never heard back, so email may be problematic. If you have not done so already, I would suggest contacting him via phone (
https://www.yelp.com/biz/data-helper-minnetonka?os...)
I've talked with Mark a few times and he is easy to reach and very friendly on the phone.
Hope this is helpful. And I'm so glad you are intent on preserving the knowledge cataloged in DataHelper.
Charlie