soap2day.global
robots.txt

Robots Exclusion Standard data for soap2day.global

Resource Scan

Scan Details

Site Domain soap2day.global
Base Domain soap2day.global
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-26T06:42:19+00:00
Next Scan 2026-03-26T06:42:19+00:00

Last Successful Scan

Scanned2025-05-08T06:33:35+00:00
URL https://soap2day.global/robots.txt
Domain IPs 104.21.14.44, 172.67.157.187, 2606:4700:3033::6815:e2c, 2606:4700:3036::ac43:9dbb
Response IP 172.67.157.187
Found Yes
Hash e8b477d9a6970fe615f240805345d8d3b74f5070f65e64659a4671289905c0c2
SimHash c104193763a1

Groups

*

Rule Path
Disallow
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://soap2day.global/sitemap.xml

Comments

  • Sitemap'i Google'a bildiriyoruz
  • Crawl hızını sınırlıyoruz, spam gibi algılanmaması için
  • Belirli dosyaların indekslenmesine izin