Hi amazing people!
I’m currently working on a project for which I require an insane amount of SGFs. I started downloading games from the API one by one with a scraper I made. However, I’m getting hit by so many 429s at this point, it’s just too slow.
I’m currently faced with 2 options. Either I stick with this option by adding to the amount of computers that constantly download games or I change the way that I’m doing things.
So I was wondering if there was a way to simply access every single SGF file behind the API and download the lot. Not only would that be simpler, but I’m also starting to feel like I’d be Ddosing OGS to some degree by adding more computers pinging the API non stop.
If you could help me out, I’d really appreciate it.
Thank you very much!