m.sporcle.com
robots.txt

Robots Exclusion Standard data for m.sporcle.com

Resource Scan

Scan Details

Site Domain m.sporcle.com
Base Domain sporcle.com
Scan Status Ok
Last Scan2024-11-04T13:02:01+00:00
Next Scan 2024-12-04T13:02:01+00:00

Last Scan

Scanned2024-11-04T13:02:01+00:00
URL https://m.sporcle.com/robots.txt
Redirect https://www.sporcle.com:443/robots.txt
Redirect Domain www.sporcle.com
Redirect Base sporcle.com
Domain IPs 3.210.9.172, 54.147.109.94, 54.172.189.120, 54.175.50.154
Redirect IPs 108.156.133.113, 108.156.133.118, 108.156.133.24, 108.156.133.35
Response IP 108.156.133.118
Found Yes
Hash dc7cc81fbf009b21dbb3d56909c1533e86b6dca8cdff9e43485049cd88c62d86
SimHash 601c99168bf1

Groups

hubspot
bytespider
gptbot
claudebot
panscient
perplexitybot
imagesiftbot
amazonbot
applebot-extended
ccbot
diffbot
facebookbot
omgili
carbon-umbrella-bot
meta-externalagent

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /reference/

*

Rule Path
Disallow /ajax/comments/
Disallow /ajax/events/
Disallow /ajax/multi_game_bookmark_check.php
Disallow /ajax/random_badge.php
Disallow /auth/
Disallow /blog/visual/
Disallow /db/
Disallow /events/mystery-round/
Disallow /framed/
Disallow /games/ajax/get_data_for_reckoning.php
Disallow /games/ajax/get_popular_info.php
Disallow /games/ajax/showdown_top_performers.php
Disallow /games/ajax/check_for_challenge.php
Disallow /leagues/
Disallow /pingdom/
Disallow /sandbox/
Disallow /search/badges/
Disallow /search/groups/
Disallow /search/events/
Disallow /search/users/
Disallow /search/playlists/
Disallow /search/events/
Disallow /search/quizzes/
Disallow /templates/
Disallow /tools/
Disallow /user/ajax/
Disallow /user/*/badges/
Disallow /user/*/challenges/
Disallow /user/*/discussions/
Disallow /user/*/likes/
Disallow /user/*/people/
Disallow /user/*/plays/
Disallow /user/*/showdowns/
Disallow /user/*/bookmarks/
Disallow /user/*/playlists/
Disallow /user/*/stats/
Disallow /user/*/sporcle-events/

Other Records

Field Value
sitemap https://www.sporcle.com/sitemap/sitemap-index.xml
sitemap https://www.sporcle.com/blog/sitemap.xml