pmxt

I didn’t expect this to blow up so much Clearly, there’s a lot of demand for this type of data and I now need to scale up the backend We got a few people reaching out, offering to help host data. This is super welcome! If anyone else wants to help out we can add you as a sponsor to our website and give you a back link to drive traffic to you Feel free to DM me or drop a message in the @devpmxt Discord Right now, the first step for us is to improve the current set up The current set up is not able to handle the load and yesterday it was crashing a lot, and even now the downloads are quite slow The plan is to migrate the data to @RustFSofficial and upgrade the server NIC. Those two change should help us handle 5-10X more downloads

I just published a data dump of full order book data from @Polymarket The data is maximally granular. There is no filtering whatsoever. Every order book change and trade is saved. Across all markets Updates are hourly. Each snapshot contains ~30M rows. Snapshots are downloaded as parquet files. Each file is approx. 500MB-1GB large. The data dump is already 2B+ rows large and growing fast. But this is just part 1/3. Coming soon is a much bigger dump that also includes @Kalshi / @opinionlabsxyz / @trylimitless etc I started collecting this data because I noticed I couldn't get it from Dome API. Their historical order book data was filtered limiting its usefulness. Also now with the acquisition there's a lot of uncertainty about whether they will continue operating

added polymarket data to the public dataset. 400m+ trades going back to 2020. 36gb compressed. MIT licensed, free to download via @Cloudflare R2.