magazine.jpost.com
robots.txt

Robots Exclusion Standard data for magazine.jpost.com

Resource Scan

Scan Details

Site Domain magazine.jpost.com
Base Domain jpost.com
Scan Status Ok
Last Scan2024-05-11T02:13:04+00:00
Next Scan 2024-05-18T02:13:04+00:00

Last Scan

Scanned2024-05-11T02:13:04+00:00
URL https://magazine.jpost.com/robots.txt
Domain IPs 13.226.120.108, 13.226.120.48, 13.226.120.8, 13.226.120.88, 2600:9000:20c7:1000:4:7381:4040:93a1, 2600:9000:20c7:4c00:4:7381:4040:93a1, 2600:9000:20c7:5600:4:7381:4040:93a1, 2600:9000:20c7:6400:4:7381:4040:93a1, 2600:9000:20c7:8a00:4:7381:4040:93a1, 2600:9000:20c7:a00:4:7381:4040:93a1, 2600:9000:20c7:d000:4:7381:4040:93a1, 2600:9000:20c7:ec00:4:7381:4040:93a1
Response IP 13.35.18.92
Found Yes
Hash f4dff70b7d4daba94f45b7b6dc5386966a940cfdff47ab7745b8ee0c3f8b1bd6
SimHash 5e0c88e12ff6

Groups

googlebot

Rule Path
Disallow /*
Allow /ads.txt

*

Rule Path
Disallow /wp-admin/
Disallow /nunchaku/kusari/*
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /wp-admin/
Disallow /nunchaku/kusari/*
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://magazine.jpost.com/sitemap.xml
sitemap https://magazine.jpost.com/sitemap.xml

Comments

  • magazine.jpost.com
  • ---
  • --

Warnings

  • `clean-param` is not a known field.