egy-news.net
robots.txt

Robots Exclusion Standard data for egy-news.net

Resource Scan

Scan Details

Site Domain egy-news.net
Base Domain egy-news.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-30T22:27:38+00:00
Next Scan 2024-08-28T22:27:38+00:00

Last Successful Scan

Scanned2024-02-01T22:26:29+00:00
URL https://egy-news.net/robots.txt
Domain IPs 104.21.59.253, 172.67.186.158, 2606:4700:3032::ac43:ba9e, 2606:4700:3037::6815:3bfd
Response IP 104.21.59.253
Found Yes
Hash 5c2427e0b4231c85b8f9fd5683cac77e9d0747954be4d0a83513f2f79841373c
SimHash 6d05d544d410

Groups

adsbot-google-mobile

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

apis-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://egy-news.net/sitemap3/sitemap2.xml
sitemap https://egy-news.net/sitemap3/sitemap2-full1.xml