omairi.club
robots.txt

Robots Exclusion Standard data for omairi.club

Resource Scan

Scan Details

Site Domain omairi.club
Base Domain omairi.club
Scan Status Ok
Last Scan2024-06-15T07:58:26+00:00
Next Scan 2024-06-22T07:58:26+00:00

Last Scan

Scanned2024-06-15T07:58:26+00:00
URL https://omairi.club/robots.txt
Domain IPs 49.212.183.100
Response IP 49.212.183.100
Found Yes
Hash 8dcf17c59ec0db2dbf3d75ea49337962edb333b13006aa5df7ed9284a1b63245
SimHash ba94298ffa70

Groups

*

Rule Path
Disallow /users/my$
Disallow /users/sign_in
Disallow /users/sign_out
Disallow /users/sign_sns
Disallow /users/sign_up_exec
Disallow /users/sign_up_check
Disallow /users/follow
Disallow /users/unfollow
Disallow /users/update
Disallow /users/slug_check
Disallow /users/*/spots
Disallow /users/*/spots/*
Disallow /users/*/pref/*
Disallow /pictures/remove
Disallow /posts/create
Disallow /posts/destroy
Disallow /comments/create
Disallow /evaluations/create
Disallow /auth
Disallow /admins
Disallow /tags

psbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

ask jeeves

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: