mit-serc.pubpub.org
robots.txt

Robots Exclusion Standard data for mit-serc.pubpub.org

Resource Scan

Scan Details

Site Domain mit-serc.pubpub.org
Base Domain pubpub.org
Scan Status Ok
Last Scan2025-08-14T04:15:30+00:00
Next Scan 2025-09-13T04:15:30+00:00

Last Scan

Scanned2025-08-14T04:15:30+00:00
URL https://mit-serc.pubpub.org/robots.txt
Domain IPs 104.26.12.150, 104.26.13.150, 172.67.75.127, 2606:4700:20::681a:c96, 2606:4700:20::681a:d96, 2606:4700:20::ac43:4b7f
Response IP 172.67.75.127
Found Yes
Hash 33e7f5664877f11f6a16773c3266a26c57958651471bddc59dbf5dfb8498c15b
SimHash e10c1d082d90

Groups

*

Rule Path
Disallow /login?redirect=*
Disallow /dash/*

Other Records

Field Value
sitemap https://mit-serc.pubpub.org/sitemap-index.xml