Log In Sign Up

buter.xyz
robots.txt

Robots Exclusion Standard data for buter.xyz

Resource Scan

Scan Details

Site Domain buter.xyz
Base Domain buter.xyz
Scan Status Ok
Last Scan2024-10-01T12:51:36+00:00
Next Scan 2024-10-08T12:51:36+00:00

Last Scan

Scanned2024-10-01T12:51:36+00:00
URL https://buter.xyz/robots.txt
Domain IPs 109.106.251.212, 2a02:4780:1:1010:0:377f:bc01:8
Response IP 109.106.251.212
Found Yes
Hash ac13ee1c01406a2186cd6fe07f7459696d88590949d58669d4afbde3088818c1
SimHash 68195822a691

Groups

*

Rule Path
Disallow /u/
Disallow /uid/
Disallow /search?q

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://buter.xyz/sitemap
Back to top