poolspanews.com
robots.txt

Robots Exclusion Standard data for poolspanews.com

Resource Scan

Scan Details

Site Domain poolspanews.com
Base Domain poolspanews.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-18T04:32:40+00:00
Next Scan 2024-11-16T04:32:40+00:00

Last Successful Scan

Scanned2023-01-23T13:46:57+00:00
URL https://poolspanews.com/robots.txt
Redirect https://www.poolspanews.com/robots.txt
Redirect Domain www.poolspanews.com
Redirect Base poolspanews.com
Domain IPs 45.60.152.237, 45.60.172.237
Redirect IPs 45.60.160.237
Response IP 45.60.160.237
Found Yes
Hash 6fcefe1e9efaa62df3d18d313d0fda4a5c2c7da33a2c465343e309517f9bea46
SimHash 2b0dd45166eb

Groups

*

Rule Path
Disallow /_debug/
Disallow /_plugins/
Disallow /ajax/
Disallow /_ajax/
Disallow /_api/
Disallow /cms/
Disallow /_cds/
Disallow /search

bingbot

Rule Path
Disallow /_debug/
Disallow /_plugins/
Disallow /ajax/
Disallow /cms/
Disallow /search
Disallow /_track

Other Records

Field Value
crawl-delay 5

turnitinbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.poolspanews.com/sitemap.xml