mobile.newsis.com
robots.txt
Robots Exclusion Standard data for mobile.newsis.com
Resource Scan
Scan Details
Site Domain | mobile.newsis.com |
Base Domain | newsis.com |
Scan Status | Ok |
Last Scan | 2024-11-11T00:21:34+00:00 |
Next Scan | 2024-12-11T00:21:34+00:00 |
Last Scan
Scanned | 2024-11-11T00:21:34+00:00 |
URL | https://mobile.newsis.com/robots.txt |
Domain IPs | 104.18.12.204, 104.18.13.204 |
Response IP | 104.18.13.204 |
Found | Yes |
Hash | 6d1d47908c4db108e989ac59c4b33f0ac944f75a2e168b32a4033045da52b25e |
SimHash | 21615f4007f5 |
Groups
googlebot
googlebot-mobile
googlebot-news
googlebot-image
mediapartners-google
popin_agent
bingbot
msnbot
msnbot-media
bingpreview
facebot
yeti
facebookexternalhit
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
twitterbot
google search console
googlebot/2.1
googlebot-smartphone
google-inspectiontool/1.0
feedfetcher-google
grapeshot
*
Rule | Path |
---|---|
Disallow | /offer/ |
Disallow | /ar_detail/ |
Disallow | /search.php |
Other Records
Field | Value |
---|---|
sitemap | https://mobile.newsis.com/sitemap.xml |
sitemap | https://mobile.newsis.com/newsis_news_google.xml |
Comments