findauction.in
robots.txt

Robots Exclusion Standard data for findauction.in

Resource Scan

Scan Details

Site Domain findauction.in
Base Domain findauction.in
Scan Status Ok
Last Scan2026-02-02T01:41:11+00:00
Next Scan 2026-02-09T01:41:11+00:00

Last Scan

Scanned2026-02-02T01:41:11+00:00
URL https://findauction.in/robots.txt
Domain IPs 139.59.46.114
Response IP 139.59.46.114
Found Yes
Hash e5758b3aed5daec8ac52eaf26a1b8fea315e842b30a56e7308aba124150f3b8a
SimHash 770cc052e350

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

openai-searcbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /listing/*/*/*/*/sortby%3Arecent
Disallow /listing/*/*/*/*/sortby%3Aprice_high
Disallow /listing/*/*/*/*/sortby%3Aprice_low
Disallow /listing/*/*/residential
Disallow /listing/*/*/residential/*
Disallow /listing/*/*/land
Disallow /listing/*/*/land/*
Disallow /listing/*/*/commercial
Disallow /listing/*/*/commercial/*
Disallow /listing/*/*/vehicle
Disallow /listing/*/*/vehicle/*
Disallow /listing/*/*/machinery
Disallow /listing/*/*/machinery/*
Allow /

Other Records

Field Value
sitemap https://findauction.in/auctionfinder.xml