mathhelpboards.com
robots.txt

Robots Exclusion Standard data for mathhelpboards.com

Resource Scan

Scan Details

Site Domain mathhelpboards.com
Base Domain mathhelpboards.com
Scan Status Ok
Last Scan2025-04-02T08:42:37+00:00
Next Scan 2025-04-09T08:42:37+00:00

Last Scan

Scanned2025-04-02T08:42:37+00:00
URL https://mathhelpboards.com/robots.txt
Redirect https://www.physicsforums.com/robots.txt
Redirect Domain www.physicsforums.com
Redirect Base physicsforums.com
Domain IPs 104.21.59.244, 172.67.185.213, 2606:4700:3031::6815:3bf4, 2606:4700:3032::ac43:b9d5
Redirect IPs 104.26.14.132, 104.26.15.132, 172.67.68.135, 2606:4700:20::681a:e84, 2606:4700:20::681a:f84, 2606:4700:20::ac43:4487
Response IP 104.26.15.132
Found Yes
Hash 3ebd6f1b62e8022d9adbbe997aad6ccfa0df694e8d516081eb116783906a1d88
SimHash 007e5e40e413

Groups

gptbot
ccbot
google-extended
bytespider
amazonbot
semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /whats-new/
Disallow /account/
Disallow /goto/
Disallow /online/
Disallow /posts/
Disallow /login/
Disallow /search/
Disallow /admin.php
Disallow /trophies*
Disallow /members/*/trophies*
Disallow /threads/*/reply?*
Disallow /tags/*/top-users
Disallow /rsscache/
Disallow /cdn-cgi/
Allow /

mediapartners-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.physicsforums.com/sitemap.php

Comments

  • Disallow AI training data collection