m.sporcle.com
robots.txt
Robots Exclusion Standard data for m.sporcle.com
Resource Scan
Scan Details
Site Domain | m.sporcle.com |
Base Domain | sporcle.com |
Scan Status | Ok |
Last Scan | 2024-11-04T13:02:01+00:00 |
Next Scan | 2024-12-04T13:02:01+00:00 |
Last Scan
Scanned | 2024-11-04T13:02:01+00:00 |
URL | https://m.sporcle.com/robots.txt |
Redirect | https://www.sporcle.com:443/robots.txt |
Redirect Domain | www.sporcle.com |
Redirect Base | sporcle.com |
Domain IPs | 3.210.9.172, 54.147.109.94, 54.172.189.120, 54.175.50.154 |
Redirect IPs | 108.156.133.113, 108.156.133.118, 108.156.133.24, 108.156.133.35 |
Response IP | 108.156.133.118 |
Found | Yes |
Hash | dc7cc81fbf009b21dbb3d56909c1533e86b6dca8cdff9e43485049cd88c62d86 |
SimHash | 601c99168bf1 |
Groups
hubspot
bytespider
gptbot
claudebot
panscient
perplexitybot
imagesiftbot
amazonbot
applebot-extended
ccbot
diffbot
facebookbot
omgili
carbon-umbrella-bot
meta-externalagent
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /ajax/comments/ |
Disallow | /ajax/events/ |
Disallow | /ajax/multi_game_bookmark_check.php |
Disallow | /ajax/random_badge.php |
Disallow | /auth/ |
Disallow | /blog/visual/ |
Disallow | /db/ |
Disallow | /events/mystery-round/ |
Disallow | /framed/ |
Disallow | /games/ajax/get_data_for_reckoning.php |
Disallow | /games/ajax/get_popular_info.php |
Disallow | /games/ajax/showdown_top_performers.php |
Disallow | /games/ajax/check_for_challenge.php |
Disallow | /leagues/ |
Disallow | /pingdom/ |
Disallow | /sandbox/ |
Disallow | /search/badges/ |
Disallow | /search/groups/ |
Disallow | /search/events/ |
Disallow | /search/users/ |
Disallow | /search/playlists/ |
Disallow | /search/events/ |
Disallow | /search/quizzes/ |
Disallow | /templates/ |
Disallow | /tools/ |
Disallow | /user/ajax/ |
Disallow | /user/*/badges/ |
Disallow | /user/*/challenges/ |
Disallow | /user/*/discussions/ |
Disallow | /user/*/likes/ |
Disallow | /user/*/people/ |
Disallow | /user/*/plays/ |
Disallow | /user/*/showdowns/ |
Disallow | /user/*/bookmarks/ |
Disallow | /user/*/playlists/ |
Disallow | /user/*/stats/ |
Disallow | /user/*/sporcle-events/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.sporcle.com/sitemap/sitemap-index.xml |
sitemap | https://www.sporcle.com/blog/sitemap.xml |