joffer.info
robots.txt

Robots Exclusion Standard data for joffer.info

Resource Scan

Scan Details

Site Domain joffer.info
Base Domain joffer.info
Scan Status Ok
Last Scan2025-12-30T13:39:19+00:00
Next Scan 2026-01-06T13:39:19+00:00

Last Scan

Scanned2025-12-30T13:39:19+00:00
URL https://joffer.info/robots.txt
Domain IPs 67.205.27.115
Response IP 67.205.27.115
Found Yes
Hash fc7482655169f8a92c1d4d8b4247c9fd2125ee00c312b98adbc33938bb5a0500
SimHash 094a5c1605e7

Groups

*

Rule Path
Allow /
Disallow /plugins/
Disallow /libs/
Disallow /includes/
Disallow /print*
Disallow /*?sort_by=
Disallow /*%26sort_by%3D
Disallow /*?sort_type=
Disallow /*%26sort_type%3D
Disallow /*confirm.html*
Disallow /*listing-details.html*
Disallow /*print.html*
Disallow /404.html*
Disallow /*listing-remove.html*
Disallow /*pdf-export.html*
Disallow /*newsletter.html*
Disallow /*gradove.html*
Disallow /*dergavi.html*
Disallow /*rabota-v-chuzhbina.html*
Disallow /*excel-import-export.html*
Disallow /*claim-listing.html*

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://joffer.info/sitemap.xml

Comments

  • robots.txt
  • Rules generated by the Sitemap plugin
  • Excluded pages: