ngedia.com
robots.txt

Robots Exclusion Standard data for ngedia.com

Resource Scan

Scan Details

Site Domain ngedia.com
Base Domain ngedia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-17T04:51:22+00:00
Next Scan 2025-07-17T04:51:22+00:00

Last Successful Scan

Scanned2025-04-26T01:32:15+00:00
URL https://ngedia.com/robots.txt
Domain IPs 2a06:41c0:1:4::26, 45.84.189.195
Response IP 45.84.189.195
Found Yes
Hash f0f5b855a33adac4c3450b345e2520af0b51e43a696ade780da5e89b48b5c317
SimHash 6015d5034593

Groups

*

Rule Path
Allow /public_html/
Disallow /public_html/ileti-rapor.php
Disallow /public_html/sisloji/
Disallow /public_html/whoisFrame/
Disallow /public_html/yeniPROJE/
Disallow /public_html/cmb/
Disallow /public_html/giris/

googlebot

Rule Path
Allow /public_html/

googlebot-image

Rule Path
Allow /public_html/

googlebot-mobile

Rule Path
Allow /public_html/

msnbot

Rule Path
Allow /public_html/

slurp

Rule Path
Allow /public_html/

teoma

Rule Path
Allow /public_html/

gigabot

Rule Path
Allow /public_html/

robozilla

Rule Path
Allow /public_html/

nutch

Rule Path
Allow /public_html/

ia_archiver

Rule Path
Allow /public_html/

baiduspider

Rule Path
Allow /public_html/

naverbot

Rule Path
Allow /public_html/

yeti

Rule Path
Allow /public_html/

yahoo-mmcrawler

Rule Path
Allow /public_html/

psbot

Rule Path
Allow /public_html/

yahoo-blogs/v3.9

Rule Path
Allow /public_html/

Other Records

Field Value
sitemap https://www.ngedia.com/sitemap.xml