bigmart.com
robots.txt

Robots Exclusion Standard data for bigmart.com

Resource Scan

Scan Details

Site Domain bigmart.com
Base Domain bigmart.com
Scan Status Ok
Last Scan2025-11-26T18:42:35+00:00
Next Scan 2025-12-03T18:42:35+00:00

Last Scan

Scanned2025-11-26T18:42:35+00:00
URL https://bigmart.com/robots.txt
Redirect https://www.bigmart.com/robots.txt
Redirect Domain www.bigmart.com
Redirect Base bigmart.com
Domain IPs 199.34.228.69
Redirect IPs 199.34.228.69
Response IP 199.34.228.69
Found Yes
Hash 42ff5d2405c07410775e506136f4e9414214c9c80a414f12afde49395e19dab0
SimHash 6854dc562793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://www.bigmart.com/sitemap.xml