makeittasty.pl
robots.txt

Robots Exclusion Standard data for makeittasty.pl

Resource Scan

Scan Details

Site Domain makeittasty.pl
Base Domain makeittasty.pl
Scan Status Ok
Last Scan2025-10-05T21:48:59+00:00
Next Scan 2025-10-12T21:48:59+00:00

Last Scan

Scanned2025-10-05T21:48:59+00:00
URL http://makeittasty.pl/robots.txt
Domain IPs 195.78.67.30
Response IP 195.78.67.30
Found Yes
Hash 655bfa97ccefae107e15f1486135b243e49d33bef35a229d4c9a81a20fdf948a
SimHash 6a0898228392

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://makeittasty.pl/wp-sitemap.xml
sitemap http://makeittasty.pl/sitemap.xml