mathematicsclassonline.com
robots.txt

Robots Exclusion Standard data for mathematicsclassonline.com

Resource Scan

Scan Details

Site Domain mathematicsclassonline.com
Base Domain mathematicsclassonline.com
Scan Status Ok
Last Scan2025-03-22T12:58:43+00:00
Next Scan 2025-04-21T12:58:43+00:00

Last Scan

Scanned2025-03-22T12:58:43+00:00
URL https://mathematicsclassonline.com/robots.txt
Domain IPs 104.21.53.54, 172.67.209.35, 2606:4700:3032::ac43:d123, 2606:4700:3037::6815:3536
Response IP 104.21.53.54
Found Yes
Hash e3f41fefd1a0b045cd2db668d9692eb0198bd6393e87d55cefcbb8c69406da87
SimHash 017d44686fb2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-includes/css/
Allow /wp-includes/js/
Allow /wp-includes/images/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ubersuggestbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mbcrawler/1.0.

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

se ranking gentle bot

Rule Path
Disallow /
Disallow /interference/hospital.php
Disallow /compact/bland.php
Disallow /white/acceptance
Disallow /button/twilight/east