Can't seem to download more than 500 rows of data from the screener

Like the title says - I ran a screen on NYSE+ AMEX+NASDAQ stocks resulting in 4744 stocks. I then applied a custom screen report and clicked on the download button. However, I only seem to get the csv data populated in the first 500 rows. How do I get the rest?

this is a limitation set by the data provider. Look in old posts in the forum on the same topic for more details.
jerome

Got it thanks… I guess the solution is to just download 500 rows at a time!

I understand there are limits due to the data providers.

I also understand there are limits to P123’s download capabilities due to hardware, network and bandwidth restrictions.

But I do not understand why the the limits on rank data exists. Perhaps this goes under the heading of limited hardware (bandwidth or network) capabilities.

I do believe there are good reasons for this. I think P123 is probably providing as much access as is possible (reasonable). I just do not understand it.

I can understand the data provider limits but can’t see why downloading sets of numbers is an issue from a hardware or bandwidth perspective. Even downloading 20-30 columns of data for 5000 stocks wouldn’t be more than a few tens or hundreds of kb in csv format

This is a data provider restriction, not a hardware or bandwidth issue. Contrary to what Jim wrote, there is no such limit on rank data from the screener. The rank data and the price for stocks ranked higher than 500 are in the downloadable CSV file. Only the data provided by the data provider is N/A.

Yuval,

There are limits on rank I believe—although they are different.

Specifically only 5 screens (showing ranks only) can be downloaded per day.

I appreciate your response. I may be wrong on this and would be VERY glad if that has changed (and to be corrected). I will check and alter this post if I am wrong on this.

EDIT: After testing this again today, there seems to be a limit, still.

I do get that I could probably take a Coursera course and in about 4 or 5 weeks I could web scrape this (probably). I am not sure why that is better for P123, however.

Here is a recent post by an advanced programmer discussing web scraping on P123 to get the data he wants: https://www.portfolio123.com/mvnforum/viewthread_thread,12424#74914

Best,

Jim


Screen Shot 2020-08-19 at 12.12.26 PM.png

Some restrictions on screen downloading have always been necessitated by our contracts with our data providers. When implementing them I don’t think anyone envisioned a screen that had no data except rank.

Yuval,

Thank you. That makes sense.

FWIW, in any future features (e.g., Data Miner), I would be needing just the ranks and the returns (along with the date and ticker).

Best,

Jim