amarujala.com
robots.txt

Robots Exclusion Standard data for amarujala.com

Resource Scan

Scan Details

Site Domain amarujala.com
Base Domain amarujala.com
Scan Status Ok
Last Scan2024-04-27T06:21:25+00:00
Next Scan 2024-05-04T06:21:25+00:00

Last Scan

Scanned2024-04-27T06:21:25+00:00
URL https://amarujala.com/robots.txt
Redirect https://www.amarujala.com/robots.txt
Redirect Domain www.amarujala.com
Redirect Base amarujala.com
Domain IPs 13.225.103.103, 13.225.103.31, 13.225.103.55, 13.225.103.56
Redirect IPs 18.155.68.113, 18.155.68.19, 18.155.68.45, 18.155.68.66
Response IP 18.155.68.113
Found Yes
Hash 9630415b1446796a3092b6e391fc15ae48591a186f7e9177ec84df7907859298
SimHash 03948060e1d3

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Allow /.well-known/amphtml/apikey.pub
Disallow /blocked.html
Disallow /entertainment/bollywood/poonam-pandey-sami-nude-pics
Disallow /static-ad/home
Disallow /ucv1/
Disallow /ajax/
Disallow /cdn-cgi/
Disallow /sports/parimatch-betting-five-qualities-of-modern-betting-all-you-need-to-know
Disallow /lifestyle/kapiva-himalayan-shilajit-from-18000-feet-himalaya-for-good-physical-and-mental-health
Disallow /tags/betting
Disallow /channels/amp_downloads*
Disallow /tags/sex*
Disallow /games/*

Other Records

Field Value
sitemap https://www.amarujala.com/sitemap.xml
sitemap https://www.amarujala.com/sitemap-news-v1.xml
sitemap https://www.amarujala.com/sitemap/sitemap-index.xml