neonetwork.pk
robots.txt

Robots Exclusion Standard data for neonetwork.pk

Resource Scan

Scan Details

Site Domain neonetwork.pk
Base Domain neonetwork.pk
Scan Status Ok
Last Scan2026-01-02T12:40:29+00:00
Next Scan 2026-01-09T12:40:29+00:00

Last Scan

Scanned2026-01-02T12:40:29+00:00
URL https://neonetwork.pk/robots.txt
Redirect https://www.neonews.pk/robots.txt
Redirect Domain www.neonews.pk
Redirect Base neonews.pk
Domain IPs 65.21.69.138
Redirect IPs 65.21.69.138
Response IP 65.21.69.138
Found Yes
Hash de98fde43b8619858059343a1248dabe9d886fc93c638325acde20768bcd7a98
SimHash 5999d1818494

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

googlebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

claudebot

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

youbot

Rule Path
Allow /

neevabot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

applebot

Rule Path
Allow /

yandex

Rule Path
Allow /
Disallow /admin/
Disallow /test-ad-code/
Disallow /xajax/
Disallow /ajax_post_update
Disallow /ajax_post_pagination
Disallow /ajax_author_type_pagination
Disallow /ajax_block_pagination
Disallow /ajax_poll_pagination
Disallow /poll_entry_submission
Disallow /parse_oembed_links
Disallow /oembed
Disallow /oembed_videos

Other Records

Field Value
sitemap https://www.neonews.pk/sitemap.xml
sitemap https://www.neonews.pk/sitemap_news.xml
sitemap https://www.neonews.pk/sitemap_news_google.xml