#noindex
3 one-liners with this tag.
All one-liners tagged noindex
Check the X-Robots-Tag header of a URL
$curl -s -o /dev/null -D - https://example.com/ | grep -i '^x-robots-tag'
Check whether WordPress blocks search engines
$wp option get blog_public --path=/var/www/vhosts/example.com/httpdocs
Find meta robots and noindex in the HTML of a page
$curl -s https://example.com/ | tr '\n' ' ' | grep -oiE '<meta[^>]*name=.?(robots|googlebot)[^>]*>'