netgaste.com
robots.txt

Robots Exclusion Standard data for netgaste.com

Resource Scan

Scan Details

Site Domain netgaste.com
Base Domain netgaste.com
Scan Status Ok
Last Scan2025-10-24T15:10:46+00:00
Next Scan 2025-10-31T15:10:46+00:00

Last Scan

Scanned2025-10-24T15:10:46+00:00
URL https://netgaste.com/robots.txt
Redirect https://www.netgaste.com/robots.txt
Redirect Domain www.netgaste.com
Redirect Base netgaste.com
Domain IPs 104.21.58.226, 172.67.209.158, 2606:4700:3032::ac43:d19e, 2606:4700:3035::6815:3ae2
Redirect IPs 104.21.58.226, 172.67.209.158, 2606:4700:3032::ac43:d19e, 2606:4700:3035::6815:3ae2
Response IP 172.67.209.158
Found Yes
Hash 87ed846e2858bb6012b594895515893f17560df588bbe51b538cdc7caeeb978d
SimHash 4098ae21c692

Groups

*

Rule Path
Disallow /haberleri?filter=
Disallow /etiket?filter=
Disallow /paylas
Disallow /paylas?
Disallow /yazdir/
Disallow /ara
Allow /

googlebot-image

Rule Path
Disallow /user
Disallow /themes/enerjik/assets/
Disallow /themes/enerjik/assets/
Allow /

adsbot-google

Rule Path
Disallow /service/stats/visitors
Disallow /service/advertchannels
Allow /

Other Records

Field Value
sitemap https://www.netgaste.com/google-news.xml
sitemap https://www.netgaste.com/sitemap.xml
sitemap https://www.netgaste.com/sitemap-latest.xml