wionews.com
robots.txt

Robots Exclusion Standard data for wionews.com

Resource Scan

Scan Details

Site Domain wionews.com
Base Domain wionews.com
Scan Status Ok
Last Scan2024-05-21T21:09:13+00:00
Next Scan 2024-05-28T21:09:13+00:00

Last Scan

Scanned2024-05-21T21:09:13+00:00
URL https://wionews.com/robots.txt
Redirect https://www.wionews.com/robots.txt
Redirect Domain www.wionews.com
Redirect Base wionews.com
Domain IPs 23.59.168.104, 2600:1413:b000:6::17d5:2bd0, 2600:1413:b000:6::17d5:2bd6
Redirect IPs 2600:1413:b000:6::17d5:2bc8, 2600:1413:b000:6::17d5:2bd9, 96.17.96.22, 96.17.96.32
Response IP 23.59.168.137
Found Yes
Hash 06242ad8eb998dfbfe067a693b165ff3b1db13d74aa40e63427fad2b4ec9d1e5
SimHash 680c8800a313

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wionews.com/googlenews.xml
sitemap https://www.wionews.com/sitemap-index.xml
sitemap https://www.wionews.com/complete-videos-sitemap.xml
sitemap https://www.wionews.com/image-sitemap.xml