Are there guidelines for reasonable API use? I got IP banned... 😢

[voltrevo]

Hi there

I’ve been slowly downloading a lot of games from the OGS api. This morning though, I found myself IP banned.

I’d like to continue with this project, but I want to make sure I’m playing by the rules. I’m making a game explorer and hope to also do some fun ML things that I hope to benefit everyone.

My script has a backoff algorithm for respecting the rate limit. Should I interpret the IP ban as just a need to give the server a break (hoping the IP ban is temporary here ) or am I doing something wrong?

[shinuito]

I think this thread here would be relevant here in terms of rate limits on downloading games, and there could be some overlap of interests

Can we get an SGF database dump?

Can we have a public database dump of all the games up until 2021 (now) from the admins? I would be happy to host it indefinitely. I run my own webserver, can make a torrent, and can put it on archive.org (Internet Archive). SGF format is probably useful for the most people. We would probably want to separate human-human, human-bot, and bot-bot games, but that could be done after the dump if needed. Same request as in (but this link is dead) and later in Othewise, I’m going to scrape game …

Someone else might come along knowing more about the ip ban/rate limit.

[GreenAsJade]

In particular Can we get an SGF database dump? - #6 by anoek

I am not aware of there being an automatic ban - I think this one would be for @anoek

You may want to PM him with your affected IP.

[voltrevo]

Yeah PM sent.

[voltrevo]

All sorted . Seems like it was just a tactical ban rather than a policy. For future reference the sgf endpoint seems to be the issue, so maybe try to avoid hitting that one hard like I was. The “moves” are there in the game data (eg) so sgf is really just a convenience.