tablebases.com
robots.txt

Robots Exclusion Standard data for tablebases.com

Resource Scan

Scan Details

Site Domain tablebases.com
Base Domain tablebases.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-03T16:28:52+00:00
Next Scan 2025-12-02T16:28:52+00:00

Last Successful Scan

Scanned2025-04-14T16:28:05+00:00
URL https://tablebases.com/robots.txt
Domain IPs 104.21.26.118, 172.67.168.69, 2606:4700:3036::ac43:a845, 2606:4700:3037::6815:1a76
Response IP 172.67.168.69
Found Yes
Hash 3058f84aa8270638b80c08b0cca282e4a2faad31fa1bd513bdab88ac26ef46fa
SimHash 6b24fc49c292

Groups

*

Rule Path
Disallow /index.php/
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /catalogsearch/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://tablebases.com/pub/pub/sitemap.xml