Please be open to feedback and constructive criticism from others, and consider their suggestions and advice when making decisions or forming opinions.
- Manlobbi
Halls of Shrewd'm / US Policy❤
No. of Recommendations: 13
I'm not sure about other locations and systems, but for me stockcharts no longer gives a graph unless you disable your ad blocker, and yahoo Finance no longer a download button at all. (it disappeared from the S&P index a while back, but is apparently now gone from all stocks)
And in one of my browsers, the stockcharts "allow cookies" page locks the screen - the "manage preferences" button does nothing, the "decline" button does nothing, and (more surprisingly) the "accept" button also does nothing, so it just sits there. Bog standard Chrome installation, no plugins, though not quite up to date version.
I have found a workaround for the price downloads--at the bottom of the Yahoo Finance home page there is a button to go back to the Yahoo classic interface, which brings back the download button on stock history pages. But I don't know how long that will be available.
Jim
No. of Recommendations: 2
I am US based using a "bog standard Chrome installation". I do not see any change in Stockchart output. The graphs seem to be the same as before.
On Yahoo Finance, the download button has a lock symbol which takes me to their new tiered offering:
https://finance.yahoo.com/about/plans/compare/Export Price History is checked under the Free tier, but does not work for me, though that could be user error on my part.
No. of Recommendations: 2
A couple of days ago the Yahoo Finance kept popping up the pay options rather than allowing me to download data. That issue is now gone and things seem to be back to what it was. I did nothing to change anything.
No. of Recommendations: 2
You used to be able to download ^GSPC (SPX) by getting the download link for anything else, like SPY, and changing the SPY ^GSPC.
Easy peasy.
A couple of weeks ago I dl'ed TQQQ using this link (omit spaces):
https: // query1.finance.yahoo.com/v7/finance/download/TQQQ?period1=1265846400&period2=1707523200&interval=1wk&events=history&includeAdjustedClose=true
I just tried it and got:
{"finance":{"result":null,"error":{"code":"forbidden","description":"User is not subscribed to Premium or has invalid cookies"}}}
Hopefully somebody will manage to find a way around it. Otherwise yahoo finance will become mostly useless to us. I cannot imagine paying $39.95/month !!!
No. of Recommendations: 2
No. of Recommendations: 2
https://finance.yahoo.com/quote/QLD/history/
The Download button is not there? The button's there for me, but when I click it I get the same JSON response Ray posted about earlier:
{"finance":{"result":null,"error":{"code":"forbidden","description":"User is not subscribed to Premium or has invalid cookies"}}}I use nasdaq.com, but my needs are very limited so don't know how it would work for others.
Brian
No. of Recommendations: 11
No. of Recommendations: 1
It generates subscription options when you try to download. There is a free option but you have to log in.
No. of Recommendations: 0
The Download button is not there?
I don't see a DOWNLOAD button, signed in or not, using New Yahoo! or classic Yahoo!.
Eric Hines
No. of Recommendations: 0
I see the download button, but it has a lock symbol next to it. Clicking on it takes me to the signup page for the $39.95/mo "Gold" level.
Yeah....no.
Frankly, if I was going to pay, there are other sites that I have much more confidence in.
Luckily download of current price of individual stocks still works. For now.
No. of Recommendations: 5
I'm in U.S.: I see under charts/historicaldata that the 'download' button has a 'locked' symbol and hitting it produces info on their tiered plans.
I tried the free plan and the download is still locked.
The jasonstrimpel page seems to be a python interface, perhaps that why it may still be working.
Frankly, if I was going to pay, there are other sites that I have much more confidence in.Lest one be tempted to pay for a Yahoo tiered plan, in the past their data has been quite buggy. I don't have a summary of examples, but saw enough to make a mental note of it.
https://www.tiingo.com/ has a $30/month or $300/year plan.
Price history of 30 years, fundamental data for 15 years.
According to their documentation, they pay significant attention to providing clean data.
I tried it some years ago when there was more data available under their free plan and thought that it was good data.
No. of Recommendations: 2
So this link does not work for you guys?
https://finance.yahoo.com/quote/QLD/history/
The Download button is not there?Nope. Not for me.
But as noted, it depends on whether you're on the new or classic site. I believe it defaults to new these days, so the link doesn't work. But if you then go to the home page of Yahoo finance, look for almost the last link at bottom right, you can switch to the classic site. Click on that, then use your link again, and the download button is back. For now, anyway.
Jim
No. of Recommendations: 4
For those of you that still have programs that download data from Yahoo, please note the following:
1. A URL like this example:
https://query1.finance.yahoo.com/v7/finance/chart/...Still works as expected. The return data is a bit awkward to work with given the format - you don't get one row of data back for each day, but instead have to "splice together" the arrays of data returned for each field (open, high, low, close, adjusted close, etc). Note that adjusted close may be inaccurate as well - I've not checked that for a while.
2. A URL like this example:
https://query1.finance.yahoo.com/v7/finance/downlo...No longer works... You get the message about not being subscribed to premium. The free "download/... endpoint is gone.
Sadly, in our age of big data, free EOD data for run-of-the-mill stock prices seems to be getting harder to find, not easier. Moving over to the URL like #1 above is not a big effort, but of course there's also a chance that will no longer work in the future as well.
If anyone has a reliable source for free EOD data that's reasonably well-maintained, I'm all ears!
Lee
(long-time lurker)
No. of Recommendations: 3
My guess is that it will have to settle down for a few days, and before long somebody will have figured out a workaround.
Keep checking the internet!
No. of Recommendations: 1
This post made me instantly flash back to when I was spending my days in a lab pushing around innocent molecules. Someone had taped up a cartoon on the bulletin board picturing the cliche man-crawling-across-the-barren-desert scene with the caption, "Data! I need data!"
--sutton
knows the feeling
No. of Recommendations: 0
What program/process do you use to read that JSON output into something where it can be "sliced"?
No. of Recommendations: 4
Saturday I noticed in my Googlefinance sheet I needed to copy out the googlefinance command for the indexes, clear the cell, then paste the formula back in to get it to refresh, but that was it.
Google Sheets with the =googlefinance formula is all you need for data/quotes you currently get from YF, including (most) daily history and mutual fund details.
FC
No. of Recommendations: 0
What program/process do you use to read that JSON output into something where it can be "sliced"?
I generally use html2text and jq.
But html2text doesn't do a good job on the raw dump of the yahoo historical web page.
It does not cut/paste into Excel cleanly, either.
No. of Recommendations: 0
Google Sheets with the =googlefinance formula is all you need for data/quotes you currently get from YF
Most of the time, not always.
BlackRock Enhanced Equity Dividend Trust (BDJ) comes back as Bendigo and Adelaide Bank Ltd.
Does not support NAV symbols at all. Ex: xETJx for the NAV of ETJ.
There is an app function "yahooF(ticker)" that can pull quotes from Yahoo.
Saturday I noticed in my Googlefinance sheet I needed to copy out the googlefinance command for the indexes, clear the cell, then paste the formula back in to get it to refresh, but that was it.
Yes, GF automatic refresh sometimes has glitches.
Most are supposed to update every 15 minutes, others every hour. The way to force it is as you said.
No. of Recommendations: 2
I've been using Jason Strimpel's bulk download page since forever.
http://finance.jasonstrimpel.com/bulk-stock-downlo...
I tried it a moment ago and it still seems to work.Thanks.
I tried it just now (Monday 10:45 AM) and it works. He must scrape the web page, because the yahoo download button is locked.
The furthest back he will go is 1990, even if yahoo has older data.
Yahoo "enhanced" their web page. It used to be you selected date range, etc. from the pulldowns and then clicked APPLY.
The order left-to-right is date range, price type, and frequency/period.
Default is 1 year, Prices, Daily. So that's the natural order you'd change the fields.
Now it's live. As soon as you change the date range to "Max" it goes off and does it. Then your browser eventually pops up with "Web page is not responding, wait or cancel?"
Go and get a cup of coffee, and by the time you get back the daily data is all there.
Again, yahoo didn't thoroughly test their update before they rolled it out.
Again.
No. of Recommendations: 4
I use the STOCKHISTORY function in Excel for historic data download. More details are on Microsoft support page for STOCKHISTORY.
The excel function is:
=STOCKHISTORY(stock, start_date, [end_date], [interval], [headers], [property0], [property1], [property2], [property3], [property4], [property5])
AJ
No. of Recommendations: 0
Google Sheets with the =googlefinance formula is all you need for data/quotes you currently get from YF, including (most) daily history and mutual fund details.
When I use google sheets, the historical data does not adjust for dividends. It does adjust for splits. Is there a function that gives dividend adjusted pricing?
Aussi
No. of Recommendations: 0
Looks like python yfinance is still working normally (for now)...
No. of Recommendations: 1
When I use google sheets, the historical data does not adjust for dividends. It does adjust for splits. Is there a function that gives dividend adjusted pricing?Not that I know of. And there's a reason.
Dividend adjusted pricing is dynamic. As you go backward in time you have to adjust the price to account for all the dividends between then and now. When a dividend occurs, ALL the historical prices must be adjusted for it.
Here's an example. I have the yahoo weekly historical data for RSP that I downloaded on 11/3/2020
Date Open High Low Close Adj Close
4/28/03 25.25 25.969999 25.1675 25.969999 20.055201
5/5/23 26.02 26.352501 25.8375 26.2125 20.24246
and the data just grabbed now, 9/9/2024
Date Open High Low Close Adj Close
Apr 28, 2003 25.25 25.97 25.17 25.97 18.77
May 5, 2003 26.02 26.35 25.84 26.21 18.95
So as you see, to have a valid adj close to use you must download the data for all the dates that you use, at each time you use different dates.
It is MUCH easier to compute the adjusted closes yourself, using the actual close price and actual dividends. As long as you have those. AFAIK, all the data sources adjust the close price & dividends for splits.
BTW, adj close for dividends is wrong anyway. Everybody calculates as if the dividend was reinvested on the ex-div date, but that is not what happens. The reinvestment is not done until later when the dividend is paid, which can be days or weeks later.
It is not clear to me if =googlefinance() gives dividends for stocks.
======================================
Well, well, well. Isn't this interesting.....Buried away in the saved HTML in addition to the above, there is some JSON data where the "adjclose" field has: 18.774974822998047, 18.950286865234375
and the "close" field has 25.969999313354492, 26.212499618530273
Yahoo isn't as clever as they thought they were.
Shhhh
No. of Recommendations: 3
If anyone has a reliable source for free EOD data that's reasonably well-maintained, I'm all ears!Nasdaq.com will give you 10 years' worth pretty easily, interactively speaking. e.g., at this link just click on "download"
https://www.nasdaq.com/market-activity/stocks/aapl...Downsides:
It does not include a dividend-adjusted series. There is a separate page for dividend history but it has no download button.
I'm not sure how well either page would work for automated scraping.
Jim
No. of Recommendations: 0
There is a separate page for dividend history but it has no download button.
Interesting: it's easy enough to copy/paste the dividend data into an Excel spreadsheet, but it pastes as a single column. Even washing it through Notepad leaves the data in a single column. However, says this non-programmer, it would seem easy enough for someone facile with Excel macros or another "language" to write a short script to reformat the data for a spreadsheet.
Eric Hines
No. of Recommendations: 4
Even washing it through Notepad leaves the data in a single column. However, says this non-programmer, it would seem easy enough for someone facile with Excel macros or another "language" to write a short script to reformat the data for a spreadsheet.
Easily fixed. The lines end with Windows CR\LF. For some reason that's the problem.
I pasted it into notepad2 and did File/Line Endings/Unix(LF).
That gets rid of the CR. Cut & paste into Excel or Libreoffice-calc or google docs and it is just fine, one line per row, columns as expected.
I can't try original notepad since I've replaced it with notepad2.
No. of Recommendations: 1
I use the STOCKHISTORY function in Excel for historic data download. More details are on Microsoft support page for STOCKHISTORY.
Thanks for the reminder. Tried that once before and discarded it as useless because the end dates for multi symbols would not match.
Maybe I can still use it with something like this for 1 yr history of prices but still no dividend.
=STOCKHISTORY(D2,TODAY()-2*365,TODAY())
GD_
No. of Recommendations: 1
Yahoo also now limits historical prices, oldest date it shows is 1/1/1985.
No. of Recommendations: 1
Yeah I've noticed for a few symbols it's required to specify the exchange - in their documentation they require the exchange but it mostly works without it, for example
BATS:MTUM instead of just MTUM
and preferred stocks are pretty finicky.
No. of Recommendations: 9
I believe awhile back Jim suggested Pinnacle as a relatively inexpensive source of timely and accurate historical equities data, either here in MI or perhaps in BRK, in the now denigrated Motley Fool realm.
In light of Yahoo's vacillating provision of free data, I'm looking for an affordable source of historical financial info. The primary challenge appears to be historical depth of prices and variety of other fundamental properties, most importantly adjustment for dividends. I gather all credible sources of simple historical closing prices are adjusted for stock splits and spin-offs.
For better or worse, about 20 years ago I retired as a software developer. Today, at mid-age 83 I regard that as a significant mistake, as ecospheric engagement evokes ongoing evolution.
By definition, retirement disentangles many erstwhile valuable relations.
We are who we are by virtue of present associations. I now welcome copacetic additions to my ecosphere.
Tom
No. of Recommendations: 4
... 20 years ago I retired as a software developer. Today, at mid-age 83 I regard that as a significant mistake, ecospheric engagement evokes ongoing evolution.
By definition, retirement disentangles many erstwhile valuable relations.
We are who we are by virtue of present associations. I now welcome copacetic additions to my ecosphere.
You remind me on my Ex. She was interoverted, for decades spoke little, never learned to speak properly, so used "her own language" = used words differently than is common agreement, saying something else than she meant, this way causing us to have huge communication problems.
You definitely did learn to speak properly. But otherwise it's the same. You use your own language which for many people is an enigma, especially for non-native English speakers like me, which anyway can easily misunderstand already simple English. I don't know why you use this language, whether it's to by purpose force people to think and contemplate what you say, or for another reason, but I doubt it works. Example: The above in my simple English I interpret as
"Being 83 now I think it was a huge mistake that 20 years ago I retired as a software developer, as it cut many valuable relations with people, with this disinvolvement stopping my own development. Realising this I now welcome new relations with my environment."
Surely this is not exactly what you mean, can't be more than a more or less good approximation. If you want more (understanding) I recommend you simplify your language, to "dumb it down". Not so if you want to be properly(???) understood a small intellectual elite only (which btw needs to be native English speakers; otherwise even members of that elite are shut out).
No. of Recommendations: 1
If anyone can figure out how to allow GTR1 to use Yahoo tickers/data again I would be extremely grateful!
Smufty
No. of Recommendations: 0
When I use google sheets, the historical data does not adjust for dividends. It does adjust for splits. Is there a function that gives dividend adjusted pricing?
Unfortunately there is not. Mutual fund historical data includes "yieldpct"; I haven't seen it because I don't use traditional mutual funds.
FC
No. of Recommendations: 4
I'm not sure about other locations and systems, but for me stockcharts no longer gives a graph unless you disable your ad blocker,
One step forward, one step back for me.
Forward:
Stockcharts have fixed the bug that their prompt will never let you accept any of the choices. I have graphs again.
Back:
But the workaround at Yahoo no longer works. (selecting the classic version of the site before going looking for the "download" link.)
As others mentioned, this now gives a JSON error, no data. I didn't think it would work for long.
However, it half works.
The new version of the site also won't let you highlight the prices in the history for a copy-paste.
If you switch to the classic version, you can highlight the rows of history and the copy-paste still works.
But if (when) that workaround goes away, or you don't like it---
In the new version (for now, anyway) you can still save the web page and look at the resulting file, not so bad. This will still give you the whole history range requested, not just the portion visible on page.
Jim
No. of Recommendations: 3
The new version of the site also won't let you highlight the prices in the history for a copy-paste.It worked for me. Here's cut/paste dividends for SPY.
Date Dividend
Jun 21, 2024 1.76 Dividend
Mar 15, 2024 1.60 Dividend
Dec 15, 2023 1.91 Dividend
Sep 15, 2023 1.58 Dividend
Jun 16, 2023 1.64 Dividend
Mar 17, 2023 1.51 Dividend
Dec 16, 2022 1.78 Dividend
Sep 16, 2022 1.60 Dividend
The html of the new version is cluttered with data to draw the charts of various markets.
Those f**kers!! They round it off! Here's the cut/paste with the classis version:
Date Dividends
Jun 21, 2024 1.759 Dividend
Mar 15, 2024 1.595 Dividend
Dec 15, 2023 1.906 Dividend
Sep 15, 2023 1.583 Dividend
Jun 16, 2023 1.638 Dividend
Mar 17, 2023 1.506 Dividend
Dec 16, 2022 1.781 Dividend
Sep 16, 2022 1.596 Dividend
But even that is rounded off.
From Nasdaq:
Ex/EFF Date Type Cash Amount Declaration Date Record Date Payment Date
06/21/2024 Cash $1.759024 01/05/2024 06/21/2024 07/31/2024
03/15/2024 Cash $1.594937 01/05/2024 03/18/2024 04/30/2024
12/15/2023 Cash $1.906073 01/19/2023 12/18/2023 01/31/2024
06/16/2023 Cash $1.638367 01/19/2023 06/20/2023 07/31/2023
03/17/2023 Cash $1.506204 01/19/2023 03/20/2023 04/28/2023
12/16/2022 Cash $1.7814 01/24/2022 12/19/2022 01/31/2023
09/16/2022 Cash $1.596398 01/24/2022 09/19/2022 10/31/2022
No. of Recommendations: 1
Have to do that same workaround of copy paste rows at barcharts historical. There’s a very specific spot on the page one has to use. Then I had to build a macro to copy the data from the pasted rows into real rows, cell by cell. P I T A.
No. of Recommendations: 0
The new version of the site also won't let you highlight the prices in the history for a copy-paste.
It worked for me. Here's cut/paste dividends for SPY.
Are you running the "new version" of the site, or old?
It definitely doesn't work for me with the "new version", just with classic, whether I'm trying stock prices or dividends.
For those who don't know what I'm talking about---
To switch from new to old, finance home, bottom right of the page, fourth last link, "back to classic yahoo!finance"
To switch from old to new, finance home, near top right of the page, "Try the new yahoo!finance ->", second from top link
The old version runs an infinite CPU loop on Firefox AND a memory leak and will crash your browser after an hour or so. So the new version does have its advantages.
Jim
No. of Recommendations: 1
Can you "copy [the entire Yahoo price page] and paste" vis-a-vis highlighting just the price history lines and pasting into a spreadsheet?
For instance, hit command-C (on a Mac) over the entire page of ^GSPC and NOT highlighting the prices outputs the following where you can delete all lines above the word "Download" and be left with your price history:
Yahoo Finance
Yahoo Finance
Search query
News
Finance
Sports
More
Mail
Sign in
My Portfolio
News
Markets
Research
Personal Finance
Videos
UPGRADE TO PREMIUM
^GSPC
S&P 500
5,633.09+0.13%
Summary
News
Chart
Community
Historical Data
Options
Components
SNP - Delayed Quote•USD
S&P 500 (^GSPC)
Follow
5,633.09+7.07(+0.13%)
At close: 4:54 PM EDT
Sep 16, 2023 - Sep 16, 2024
Historical Prices
Daily
Currency in USD
Download
Date Open High Low Close Adj Close Volume
16-Sep-24 5,615.21 5,636.05 5,604.53 5,633.09 5,633.09 2,318,065,000
13-Sep-24 5,603.34 5,636.27 5,601.65 5,626.02 5,626.02 3,500,790,000
12-Sep-24 5,557.48 5,600.71 5,535.50 5,595.76 5,595.76 3,655,070,000
11-Sep-24 5,496.42 5,560.41 5,406.96 5,554.13 5,554.13 3,839,450,000
10-Sep-24 5,490.51 5,497.91 5,441.72 5,495.52 5,495.52 3,848,180,000
9-Sep-24 5,442.07 5,484.20 5,434.49 5,471.05 5,471.05 3,825,940,000
6-Sep-24 5,507.33 5,522.47 5,402.62 5,408.42 5,408.42 3,822,800,000
5-Sep-24 5,520.08 5,546.30 5,480.54 5,503.41 5,503.41 3,521,650,000 ...
No. of Recommendations: 2
Oh my heavens.
I just used Firefox to this link:
https://finance.yahoo.com/quote/SPY/history/?filte...Firefox 130.0(64-bit) Windows, up to date.
New yahoo, cut & paste into Excel 2003 worked fine.
It pasted into LibreOffice Calc Version: 24.8.0.3 (X86_64) fine, too.
Oddly, I didn't have to convert the CR/LF line endings to just LF like I had to the other day.
Old yahoo/classic cut&pasted worked fine, too.
Brave worked with yahoo/classic.
"Brave is up to date
Version 1.69.168 Chromium: 128.0.6613.138 (Official Build) (64-bit)"
For some reason, Brave could not switch to new yahoo until I turned off AdBlockUltimate.
But that cut/pasted fine, too.
I'm running Windows 10.
No. of Recommendations: 0
I just highlighted the data area, from the column headers
"Date Open High Low Close Adj Close Volume"
to the last row of the data (ending with the volume field)
and hit CTRL-C. (copy)
The opened up Excel and hit CTRL-V (paste).
{Hmmmm, Adj Close and Volume headers are on their own lines.}
Then to clear out the crud, delete all the Dividend & other non-price lines.
No. of Recommendations: 0
Has anyone used IB's API's to retrieve historical data? Wonder how well that works.
Mark
No. of Recommendations: 2
Can you "copy [the entire Yahoo price page] and paste" vis-a-vis highlighting just the price history lines and pasting into a spreadsheet?
For instance, hit command-C (on a Mac) over the entire page of ^GSPC and NOT highlighting the prices outputs the following where you can delete all lines above the word "Download" and be left with your price history:
That doesn't work on my browser. I get the headers and so on, down to "Feedback", but no price data.
But "File | Save page as..." works, selecting .txt format.
Jim
No. of Recommendations: 1
That doesn't work on my browser.
I have visited many web pages that don't work on one browser or another. And, of course, various ad blockers interfere with various web pages.
For browsers my primary one is slimjet, then Brave. These work on 90% of the sites I visit.
I also have firefox, vivaldi, thorium, waterfox, and librewolf.
My wife uses Brave exclusively.
I find yahoo's attempts puzzling. They make a change to make it difficult, yet it is not particularly difficult to get around what they are attempting to charge $50/mo for.
Just have to jump through some minor hoops. What used to be easy to automate has to be done manually. But still simple.
The next step we'll have to do is a way to feed keystrokes & mouse movements to the browser. I know this is possible, we used to do it at work in our regression tests. Just hasn't been annoying enough SO FAR to look up how to do it.
No. of Recommendations: 0
a way to feed keystrokes & mouse movements to the browser.
Windows Scripting Host (WSH), SendKeys Method
(A lot of trial and error until something complex works, but doable - - - until the unavoidable next change of the website in the name of "more modern" layout).
