project-syndicate.org
robots.txt

Robots Exclusion Standard data for project-syndicate.org

Resource Scan

Scan Details

Site Domain project-syndicate.org
Base Domain project-syndicate.org
Scan Status Ok
Last Scan2024-10-18T14:24:43+00:00
Next Scan 2024-11-17T14:24:43+00:00

Last Scan

Scanned2024-10-18T14:24:43+00:00
URL https://project-syndicate.org/robots.txt
Redirect https://www.project-syndicate.org/robots.txt
Redirect Domain www.project-syndicate.org
Redirect Base project-syndicate.org
Domain IPs 23.97.214.177
Redirect IPs 217.147.220.24
Response IP 217.147.220.24
Found Yes
Hash a82fc282c68552c7604acefc9fe9016d51d173c16d5ec7095e91f60b603128d3
SimHash 010458449d51

Groups

*

Rule Path
Disallow /flowli/
Disallow /print/
Disallow /login/
Disallow /register/
Disallow /iptest
Disallow /handbook
Disallow /newsletters/*$

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.project-syndicate.org/sitemap.xml
sitemap https://www.project-syndicate.org/news-sitemap.xml