avere.org
robots.txt

Robots Exclusion Standard data for avere.org

Resource Scan

Scan Details

Site Domain avere.org
Base Domain avere.org
Scan Status Ok
Last Scan2024-11-05T00:17:19+00:00
Next Scan 2024-11-19T00:17:19+00:00

Last Scan

Scanned2024-11-05T00:17:19+00:00
URL https://avere.org/robots.txt
Redirect https://www.avere.org/robots.txt
Redirect Domain www.avere.org
Redirect Base avere.org
Domain IPs 213.193.247.32
Redirect IPs 213.193.247.32
Response IP 213.193.247.32
Found Yes
Hash 92ade2a58def95e17ad727a7b20415f2080f5c66f00cee60270a106ddf8e585f
SimHash c855c6034592

Groups

*

Rule Path
Disallow

jobdiggerspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

olbicobot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.avere.org/l/sitemaps/index

Comments

  • Allow all

Warnings

  • 2 invalid lines.