sporcle.com
robots.txt

Robots Exclusion Standard data for sporcle.com

Resource Scan

Scan Details

Site Domain sporcle.com
Base Domain sporcle.com
Scan Status Ok
Last Scan2024-04-24T04:36:18+00:00
Next Scan 2024-05-01T04:36:18+00:00

Last Scan

Scanned2024-04-24T04:36:18+00:00
URL https://sporcle.com/robots.txt
Redirect https://www.sporcle.com:443/robots.txt
Redirect Domain www.sporcle.com
Redirect Base sporcle.com
Domain IPs 34.196.157.131, 34.232.131.128, 44.207.150.52, 54.82.242.10
Redirect IPs 108.156.133.113, 108.156.133.118, 108.156.133.24, 108.156.133.35
Response IP 108.156.133.35
Found Yes
Hash 34d54c5349506efbf6f4786974bc0a42c6a02808c25f80fac975345042c47d60
SimHash e93498122bf3

Groups

hubspot
bytespider
gptbot
claudebot

Rule Path
Disallow /

*

Rule Path
Disallow /auth/
Disallow /blog/visual/
Disallow /db/
Disallow /events/mystery-round/
Disallow /framed/
Disallow /leagues/
Disallow /pingdom/
Disallow /sandbox/
Disallow /search/badges/
Disallow /search/groups/
Disallow /search/events/
Disallow /search/users/
Disallow /search/playlists/
Disallow /search/events/
Disallow /search/quizzes/
Disallow /templates/
Disallow /tools/
Disallow /user/*/badges/
Disallow /user/*/challenges/
Disallow /user/*/discussions/
Disallow /user/*/likes/
Disallow /user/*/people/
Disallow /user/*/plays/
Disallow /user/*/showdowns/
Disallow /user/*/bookmarks/
Disallow /user/*/playlists/
Disallow /user/*/stats/
Disallow /user/*/sporcle-events/

Other Records

Field Value
sitemap https://www.sporcle.com/sitemap/sitemap-index.xml
sitemap https://www.sporcle.com/blog/sitemap.xml