appclap.org
robots.txt

Robots Exclusion Standard data for appclap.org

Resource Scan

Scan Details

Site Domain appclap.org
Base Domain appclap.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-11-15T03:52:06+00:00
Next Scan 2025-02-13T03:52:06+00:00

Last Successful Scan

Scanned2024-07-19T03:50:27+00:00
URL https://appclap.org/robots.txt
Domain IPs 104.21.73.161, 172.67.163.219, 2606:4700:3033::ac43:a3db, 2606:4700:3035::6815:49a1
Response IP 104.21.73.161
Found Yes
Hash 09c95adf9563da6d0160e0b8f6cbbc716c0f5e95f3908e43a8a0911eff3feee8
SimHash 500dca224e92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

seznam

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

Other Records

Field Value
sitemap https://appclap.org/sitemap_index.xml