asigazetesi.com
robots.txt

Robots Exclusion Standard data for asigazetesi.com

Resource Scan

Scan Details

Site Domain asigazetesi.com
Base Domain asigazetesi.com
Scan Status Ok
Last Scan5/25/2025, 1:39:42 AM
Next Scan 6/24/2025, 1:39:42 AM

Last Scan

Scanned5/25/2025, 1:39:42 AM
URL https://asigazetesi.com/robots.txt
Redirect https://www.asigazetesi.com/robots.txt
Redirect Domain www.asigazetesi.com
Redirect Base asigazetesi.com
Domain IPs 104.21.8.112, 172.67.157.86, 2606:4700:3034::ac43:9d56, 2606:4700:3037::6815:870
Redirect IPs 104.21.8.112, 172.67.157.86, 2606:4700:3034::ac43:9d56, 2606:4700:3037::6815:870
Response IP 172.67.157.86
Found Yes
Hash e575b95a35683704c359bf801ea62a6a3bf8f4ef3608536700b3f4e25bf9ae69
SimHash 6908be63ac93

Groups

*

Rule Path
Disallow /public
Disallow /public/*
Disallow /service*
Disallow /arama
Disallow /tr/*
Disallow /api
Disallow /*?q=
Disallow /*?preview=
Disallow /*?utm_source=
Disallow /*?page=
Disallow /*?cursor=
Disallow /service/
Allow /

adsbot-google

Rule Path
Disallow /advert/*
Allow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seekportbot

Rule Path
Disallow /haberleri/

Other Records

Field Value
sitemap https://www.asigazetesi.com/sitemap.xml