Log In Sign Up

dealground.in
robots.txt

Robots Exclusion Standard data for dealground.in

Resource Scan

Scan Details

Site Domain dealground.in
Base Domain dealground.in
Scan Status Ok
Last Scan2024-05-24T21:45:51+00:00
Next Scan 2024-06-23T21:45:51+00:00

Last Scan

Scanned2024-05-24T21:45:51+00:00
URL https://dealground.in/robots.txt
Domain IPs 75.2.60.5
Response IP 75.2.60.5
Found Yes
Hash 8151551fcfe5291525ebeb89b24fd577107561ea2d0bc5374d238df32f4d48f4
SimHash 04306e92f473

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /api/

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Comments

  • www.robotstxt.org/
  • Allow crawling of all content
  • Disallow crawling of API endpoints for all bots
Back to top

Warnings

  • 2 invalid lines.
Back to top