mylist.co.il
robots.txt

Robots Exclusion Standard data for mylist.co.il

Resource Scan

Scan Details

Site Domain mylist.co.il
Base Domain mylist.co.il
Scan Status Ok
Last Scan2024-11-13T22:21:01+00:00
Next Scan 2024-11-20T22:21:01+00:00

Last Scan

Scanned2024-11-13T22:21:01+00:00
URL https://mylist.co.il/robots.txt
Domain IPs 104.21.57.186, 172.67.165.117, 2606:4700:3035::6815:39ba, 2606:4700:3036::ac43:a575
Response IP 172.67.165.117
Found Yes
Hash f844401e6de4735ec3cc4b0d801122f85821a521817895591ef751f2cd6e40de
SimHash 310390086f94

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin

Other Records

Field Value
sitemap https://www.mylist.co.il/sitemap_index.xml

Comments

  • Robots.txt generated by Booter - Crwalers Manager at Tue, 23 Feb 2021 01:00:57 +0000
  • Do not modify this file, any contents will be overwritten