Are there guidelines for reasonable API use? I got IP banned... 😢

[voltrevo]

Hi there

I’ve been slowly downloading a lot of games from the OGS api. This morning though, I found myself IP banned.

I’d like to continue with this project, but I want to make sure I’m playing by the rules. I’m making a game explorer and hope to also do some fun ML things that I hope to benefit everyone.

My script has a backoff algorithm for respecting the rate limit. Should I interpret the IP ban as just a need to give the server a break (hoping the IP ban is temporary here ) or am I doing something wrong?

[shinuito]

I think this thread here would be relevant here in terms of rate limits on downloading games, and there could be some overlap of interests

Can we get an SGF database dump?

UPDATES OK, the SGF conversion is complete. All games are available for download as SGF files or as JSON files. My current organization is to have two downloads available–one organized by date, and one by username. The SGF collection is about 11GB compressed. Current hosting is at za3k - OGS Go game collection on my home server. OK, I uploaded it to Internet Archive as well OGS 2021 collection of Go games : Zachary Vance / OGS : Free Download, Borrow, and Streaming : Internet Archive Origin…

Someone else might come along knowing more about the ip ban/rate limit.

[GreenAsJade]

In particular Can we get an SGF database dump? - #6 by anoek

I am not aware of there being an automatic ban - I think this one would be for @anoek

You may want to PM him with your affected IP.

[voltrevo]

Yeah PM sent.

[voltrevo]

All sorted . Seems like it was just a tactical ban rather than a policy. For future reference the sgf endpoint seems to be the issue, so maybe try to avoid hitting that one hard like I was. The “moves” are there in the game data (eg) so sgf is really just a convenience.