Log In Sign Up

auctionflippers.com
robots.txt

Robots Exclusion Standard data for auctionflippers.com

Resource Scan

Scan Details

Site Domain auctionflippers.com
Base Domain auctionflippers.com
Scan Status Ok
Last Scan2026-04-12T06:55:22+00:00
Next Scan 2026-04-19T06:55:22+00:00

Last Scan

Scanned2026-04-12T06:55:22+00:00
URL https://auctionflippers.com/robots.txt
Domain IPs 104.21.57.55, 172.67.159.143, 2606:4700:3032::ac43:9f8f, 2606:4700:3036::6815:3937
Response IP 172.67.159.143
Found Yes
Hash cde71c3e200c01e3b9c774bafb4199abc8e3ec1e6aee84f2307c7cdd18fd5dc4
SimHash 29007e32a621

Groups

*

Rule Path
Allow /
Allow /equipment/
Allow /analytics/
Disallow /admin/
Disallow /scrape-range/
Disallow /test/
Disallow /api/
Disallow /images/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://auction.auctionflippers.com/sitemap.xml
Back to top

Comments

  • Sitemap
  • Allow crawling of equipment pages
  • Disallow admin and internal URLs
  • Crawl delay to be respectful
Back to top