mathsisfun.com
robots.txt

Robots Exclusion Standard data for mathsisfun.com

Resource Scan

Scan Details

Site Domain mathsisfun.com
Base Domain mathsisfun.com
Scan Status Ok
Last Scan2024-09-21T02:21:12+00:00
Next Scan 2024-09-28T02:21:12+00:00

Last Scan

Scanned2024-09-21T02:21:12+00:00
URL https://mathsisfun.com/robots.txt
Domain IPs 104.22.10.27, 104.22.11.27, 172.67.10.26, 2606:4700:10::6816:a1b, 2606:4700:10::6816:b1b, 2606:4700:10::ac43:a1a
Response IP 172.67.10.26
Found Yes
Hash 211d7bed8d4a6200deae1a04111226406deb58834ce2434cae0698d256733100
SimHash ed40c904d397

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /worksheets/print.php
Disallow /worksheets/printget.php
Disallow /worksheets/create-row.php
Disallow /worksheets/create-settings.php
Disallow /worksheets/generic-register.php
Disallow /worksheets/generic-login.php
Disallow /includes/
Disallow /handle-404-sorry.php

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10