mobile.newsis.com
robots.txt

Robots Exclusion Standard data for mobile.newsis.com

Resource Scan

Scan Details

Site Domain mobile.newsis.com
Base Domain newsis.com
Scan Status Ok
Last Scan2024-09-11T20:04:35+00:00
Next Scan 2024-10-11T20:04:35+00:00

Last Scan

Scanned2024-09-11T20:04:35+00:00
URL https://mobile.newsis.com/robots.txt
Domain IPs 104.18.12.204, 104.18.13.204
Response IP 104.18.13.204
Found Yes
Hash 6d1d47908c4db108e989ac59c4b33f0ac944f75a2e168b32a4033045da52b25e
SimHash 21615f4007f5

Groups

googlebot
googlebot-mobile
googlebot-news
googlebot-image
mediapartners-google
popin_agent
bingbot
msnbot
msnbot-media
bingpreview
facebot
yeti
facebookexternalhit
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
twitterbot
google search console
googlebot/2.1
googlebot-smartphone
google-inspectiontool/1.0
feedfetcher-google
grapeshot
*

Rule Path
Disallow /offer/
Disallow /ar_detail/
Disallow /search.php

Other Records

Field Value
sitemap https://mobile.newsis.com/sitemap.xml
sitemap https://mobile.newsis.com/newsis_news_google.xml

Comments

  • Robots for mobile.newsis.com
  • Sitemap