hindi.thequint.com
robots.txt

Robots Exclusion Standard data for hindi.thequint.com

Resource Scan

Scan Details

Site Domain hindi.thequint.com
Base Domain thequint.com
Scan Status Ok
Last Scan2024-04-15T16:23:34+00:00
Next Scan 2024-05-15T16:23:34+00:00

Last Scan

Scanned2024-04-15T16:23:34+00:00
URL https://hindi.thequint.com/robots.txt
Domain IPs 104.18.90.198, 104.18.91.198, 104.18.92.198, 104.18.93.198, 104.18.94.198, 2606:4700::6812:5ac6, 2606:4700::6812:5bc6, 2606:4700::6812:5cc6, 2606:4700::6812:5dc6, 2606:4700::6812:5ec6
Response IP 104.18.90.198
Found Yes
Hash 0f2d1f2c59fea864c90de7854b01349e7c605c32955f295a81d41327a422ac51
SimHash 08150cc0ed93

Groups

*

Rule Path
Disallow /story/
Disallow /preview/
Disallow /static/
Disallow /api/auth/
Disallow /api/access/
Disallow /*?prerender=true
Disallow /thequint/assets/
Disallow /api/v1/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hindi.thequint.com/sitemap/today
sitemap https://hindi.thequint.com/sitemap/yesterday