phys.b-cdn.net
robots.txt
Robots Exclusion Standard data for phys.b-cdn.net
Resource Scan
Scan Details
Site Domain | phys.b-cdn.net |
Base Domain | b-cdn.net |
Scan Status | Ok |
Last Scan | 2025-02-26T10:30:00+00:00 |
Next Scan | 2025-03-28T10:30:00+00:00 |
Last Scan
Scanned | 2025-02-26T10:30:00+00:00 |
URL | https://phys.b-cdn.net/robots.txt |
Domain IPs | 138.199.46.68, 2400:52e0:1500::868:1 |
Response IP | 138.199.46.68 |
Found | Yes |
Hash | 10b4f964466974da792a3bbfb3f593762e27b366db37a6a69dd6c64cf5c5a81e |
SimHash | 301c5943e0e3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /search/ |
Disallow | /rss-feed/search/ |
Disallow | /rss-feed/breaking/search/ |
Disallow | /rss-feed/tags/ |
Disallow | /*/sort/ |
Other Records
Field | Value |
---|---|
sitemap | https://phys.org/sitemap/indx/ |