thecurrent.org
robots.txt

Robots Exclusion Standard data for thecurrent.org

Resource Scan

Scan Details

Site Domain thecurrent.org
Base Domain thecurrent.org
Scan Status Ok
Last Scan2025-08-08T04:39:42+00:00
Next Scan 2025-08-15T04:39:42+00:00

Last Scan

Scanned2025-08-08T04:39:42+00:00
URL https://thecurrent.org/robots.txt
Redirect https://www.thecurrent.org/robots.txt
Redirect Domain www.thecurrent.org
Redirect Base thecurrent.org
Domain IPs 52.202.186.183
Redirect IPs 3.169.71.117, 3.169.71.3, 3.169.71.6, 3.169.71.9
Response IP 52.85.5.32
Found Yes
Hash b4a2f566ad67fe3769317d350d7ff086b7371ab4e1e97e9201bf584da80e6437
SimHash 4a9c8070c302

Groups

*

Rule Path
Allow /
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /*.js$
Disallow /search
Disallow /images/mpr-logo-white.svg

oai-searchbot
meta-externalagent
ahrefsbot
amazonbot
imagesiftbot
blexbot
trendictionbot
chatgpt-user
dataforseobot

Rule Path
Disallow /