newsgeek.com.br
robots.txt

Robots Exclusion Standard data for newsgeek.com.br

Resource Scan

Scan Details

Site Domain newsgeek.com.br
Base Domain newsgeek.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-21T00:13:46+00:00
Next Scan 2024-11-19T00:13:46+00:00

Last Successful Scan

Scanned2023-08-03T18:54:57+00:00
URL https://newsgeek.com.br/robots.txt
Domain IPs 104.26.12.194, 104.26.13.194, 172.67.69.224, 2606:4700:20::681a:cc2, 2606:4700:20::681a:dc2, 2606:4700:20::ac43:45e0
Response IP 172.67.69.224
Found Yes
Hash 70d6ff1151b5c19599a22d2bb9cec9c8c82f4acde7abd1149648b5259865ef3a
SimHash 49010c404993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://newsgeek.com.br/sitemap_index.xml