129 questions
-1
votes
1
answer
27
views
only want to index the text content of the login page
I have a login page with text content but i only want to index the text content of that page. So which tag should i use for this?
Suppose i have a page abc.com/xyz/life-hack and this page has text ...
4
votes
1
answer
2k
views
Vercel Next.js app pages not indexed by Google
I built an app using Next.js, but already one month past, all pages were not indexed by Google. I tried to add sitemap and robots.txt, now they can crawl but can not be indexed by Google.
Most of ...
- 413
1
vote
0
answers
27
views
filtered special Database statements for google index
I have the url() statement in my database. all in www.site.com/random_alias format (splash pages).
Some links were created by the admin (userid=1) and archived to specialized (archived=1).
how can I ...
- 21
0
votes
1
answer
110
views
Noindex File page on Gatsby?
I have a static site in Gatsby. I'm using an <a> tag to link to a pdf file to download, shortened version below:
import file from '../files/file.pdf';
<a
className='hover:underline hover:...
- 113
0
votes
1
answer
196
views
Add metatag noindex,nofollow to individual Kentico pages
We are looking to add meta noindex,nofollow tags to certain pages on our Kentico MVC site. Documentation states that if you choose "Exclude from Search", Kentico will add these noindex,...
- 1
0
votes
0
answers
340
views
htaccess "Header set X-Robots-Tag noindex" works for .html only, doesn't work for .jpg or .pdf
I have a shared webspace where I use .htaccess with no problems so far.
Today I created a directory with some PDFs and JPGs inside. Not secret, but I don't like to see it in search results. Structure ...
- 2,100
1
vote
0
answers
57
views
Noindex 4000 urls using x-tag-robots via htaccess
I need to noindex 4000 URLs.
I wanna do it using x-robots-tag via htaccess, but I don't want to overload the htaccess with such infinite list of URLs, so...
The idea would be to create the list in a ...
- 23
1
vote
1
answer
529
views
Using X robot tags to in .htaccess file to de index query strings URL from Google
I am looking for a solution to deindex all the URLs with query strings ?te= from Google. From example I want to deindex all the URLs https://example.com/?te= from Google.
Google has currently indexed ...
0
votes
0
answers
1k
views
How to disable noindex for just certain pages in Vue 2?
I have noindex enabled in my entire Vue app using { name: 'robots', content: 'noindex' }, but I want to enable it just for some pages. I am using Vue 2 and webpack 4.46.0.
Is there a way to disable ...
0
votes
1
answer
388
views
Will "noindex" tags inside an iframe affect the parent page?
I have a page on my site that gets loaded in an iframe on the homepage. This page is not supposed to be directly accesible, so I don't want it to show up in search results, so I put "noindex"...
- 4,933
0
votes
1
answer
707
views
Added HTML meta "robots" directive to "noindex", Google still shows my website in search results
I want Google to not show my website in search results (since its for internal users spread across the globe). As documented at https://developers.google.com/search/docs/crawling-indexing/robots-meta-...
- 629
1
vote
1
answer
2k
views
How to no-index specific pages on shopify? Don't want to use "contains" example for shopify, can I just type "="? And what denotes as the handle?
Shopify says to utilize the following sample to noindex a specific page in shopify.
To exclude a specific page, paste the following code in the section:
{% if handle contains 'page-handle-you-want-to-...
- 11
0
votes
1
answer
366
views
Can I use typographically quotation marks in HTML's meta tag
I've found a site where one meta tag is looking like that:
<meta name="”robots”" content="”noindex,nofollow”">
Please not that the values for both attributes is additionally ...
- 1,362
-1
votes
1
answer
152
views
Stop some subdomains xxx.xxx.com of a single website being indexed by search engines
I need to stop indexing subdomains of a same site, for example:
aaa.xxx.com: (No indexing)
bbb.xxx.com: (No indexing)
www.xxx.com: (It should indexed)
All the subdomains are under the same domain. ...
0
votes
1
answer
557
views
How to remove noindex from HTTP response header
Want to remove noindex tag from the HTTP header:
I'm using instance on AWS. The web server is open lightspeed + WordPress.
I want to submit my site map to Google site all of my pages and post can be ...
- 11
1
vote
1
answer
41
views
Googlebot and create PDF
I just added <meta name="googlebot" content="noindex"> in my site which produces a pdf file with MVC 5 and the file is no longer created.
Does anyone have any idea how the ...
11
votes
1
answer
2k
views
FastAPI, robots.txt and noindex
Does FastAPI need robots.txt and the tag noindex?
I am creating business api app which shouldn't be called by anonymous.
So I wonder whether I have to prepare robots.txt and the tag noindex in order ...
- 111
1
vote
0
answers
589
views
Set noindex nofollow on posts from multiple categories using Yoast WordPress SEO
This Wordpress filter sets noindex nofollow for a single category, but how would I do the same for multiple categories, for example, if I wanted to noindex nofollow category1, category2, category3, ...
- 37
0
votes
1
answer
929
views
Setting noindex nofollow in a category page of Magento site
With the observer class below, I'm trying to set noindex and nofollow on a category page. I'm unable to get the code to first check if it is a category page and then set noindex if the title of the ...
- 749
0
votes
1
answer
874
views
Magento 2.4.2: The following modules are outdated: Perfectmakeupmirrors_PmmHead schema: current version - none, required version - 0.0.1
I just created a custom module to add a metatag in the head of a category page of our Magento site by making use of event and observer. When reloading the category page, below is the error I see. I re-...
- 749
0
votes
1
answer
85
views
Want to disallow few url with the robots.txt
I want to block a few URLs in robots.txt, but I really don't know how to do this.
Below I have mentioned the URL, How should I disallow the dynamic URL. I really appreciate it if you help me to get ...
- 19
0
votes
1
answer
2k
views
NGINX target specific upload files on different folders
I need to add a noindex tag to multiple specific uploaded files, but they all belong to different year and month upload folders like this for example:
/var/www/public/app/uploads/2021/06/file-1.pdf
/...
- 660
-2
votes
1
answer
125
views
C# Winforms: Add new row to unbound(!) datagridview with the use of column names
I have a custom DGV (dgvPaths) with 2 buttons as first 2 columns:
DataGridViewButtonColumn btnColRemove = new DataGridViewButtonColumn();
btnColRemove.Name = "Remove";
...
- 406
1
vote
0
answers
465
views
X-Robots noindex all wordpress URLs in specific subdirectory
I want to noindex all websites/URLs in the subdirectory "author".
Examples:
example.com/author/torben
example.com/author/lucy
example.com/author/*
.htaccess seems to be the right place to ...
- 11
0
votes
1
answer
753
views
how fixed Blocked by robots.txt in wordpress?
My site robots.txt commands include this
User-agent: *
Disallow: /wp-admin/
Allow: /
My problem is in the google search console in live testing
Displays this error for my site pages
Blocked by ...
1
vote
0
answers
668
views
X robots tag to noindex a single pdf file
I need tour help. I have the need to noindex a single pdf file. I know that if i wanted to noindex all pdf files it would be great to use the x-robots tag
<FilesMatch ".pdf$">
Header ...
- 11
0
votes
1
answer
1k
views
Unable to read sitemap: Google Search Console
Sitemap could not be read
General HTTP error
1 instance
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the ...
0
votes
1
answer
133
views
Prestashop multishop: how no-index Alias subdomain
In a shop created with PS 1.7.6.1 we have created a resellers "view";
At the moment we have the mail webshop for B2C on www.domainname.com and a view with reseller.domainname.com (for B2B ...
- 1
0
votes
2
answers
1k
views
How to noindex pagination pages
How to I add a noindex tag to pagination pages for categories in Shopify?
I've found apps that claim to do it, but I believe it should be able I can do without an app.
Thanks
- 321
1
vote
0
answers
50
views
The URL submitted contains the noindex tag google
I have a few links that I do not want to be indexed by Google. But googleshows me the following statistics error.
The weirdest part is that I configured these links not to be indexed.
Like I set a ...
- 11
0
votes
1
answer
1k
views
Noindex specific category pagination pages
WooCommerce is creating category pagination pages for parent categories. We don't want these indexed, but I can't work out how best to do this.
For instance I have
https://www.i-hled.co.uk/product-...
- 79
1
vote
1
answer
123
views
How to add noindex tag to certain media categories in Xenforo
I'm trying to exclude from search certain media gallery categories in Xenforo but it doesn't works.
I add the following code in xfmg_media_view template.
<xf:if is="{$media.category_id} == 1">
...
- 11
1
vote
2
answers
3k
views
Can Squarespace Tag Pages Be NoIndexed?
I would like to "noindex" all tag pages on a Squarespace site. Unfortunately, since Squarespace doesn't allow access to the .htaccess file or even the robots.txt file and since tag pages are ...
- 819
0
votes
1
answer
959
views
Do not index all stores in multi-store prestashop 1.7
I have a multi-shop and I want one of the stores not to be indexed in any browser. What do I have to do to avoid indexing? The problem is that they share the robots. What I can do?
Can you do that a ...
- 67
0
votes
2
answers
465
views
robots.txt handling a # in a URL
Given the following URLs:
example.com/products
example.com/products#/page-2
example.com/products#/page-3
...
By using the robots.txt file, the first URL (example.com/products) is supposed to be ...
- 1
2
votes
1
answer
491
views
How to set noindex for Google only?
These days Google has this tag I can use to tell it not to index a page
<meta name="googlebot" content="noindex">
My question is do I need both the generic index and the Google noindex tags ...
- 27.1k
0
votes
2
answers
4k
views
How to Add noindex for specific page in Shopify store
I have a Shopify store and I want to block search engines to index some products pages, I found this solution https://help.shopify.com/en/manual/promoting-marketing/seo/hide-a-page-from-search-engines?...
- 11
1
vote
1
answer
1k
views
How to fix - Indexed, though blocked by robots.txt?
I have just received an email regarding Index coverage issues for my site.
The following file is indexed by the Google:
root-of-my-site/files/custom.js
Please note that I have disallowed /files ...
- 49
0
votes
1
answer
874
views
How to use noindex when my <head> is included in all pages with php include?
I need to use <meta name="robots" content="noindex"> in my "thank you page".
Google instructions says that I need to put it between <head> tags but my head tags are shared (php included) ...
3
votes
2
answers
4k
views
Noindex in a robots.txt
I've always stopped google from indexing my website using a robots.txt file. Recently i've read an article from a google employee where he stated you should do this using meta tags. Does this mean ...
- 83
2
votes
2
answers
4k
views
robots.txt and disalowing absolute path URL
I am using Heroku pipes. So when I push my application it is pushed to staging app
https://appname.herokuapp.com/
and if everything is correct I promote that app to prodcution. There is no new build ...
- 3,867
11
votes
3
answers
29k
views
What is the difference between "index, follow" or "follow"?
What are the differences in the lists below:
<meta name="robots" content="index, follow">
<meta name="robots" content="follow">
<meta name=&...
0
votes
1
answer
3k
views
How do I stop Wordpress from inserting a noindex meta tag?
I'm trying to get my website to be indexed by search engines. According to this, something from Wordpress is injecting a meta tag that's preventing search engines from crawling my site: https://aw-...
- 173
0
votes
1
answer
869
views
Prestashop - noindex, nofollow in Multistore
I have shop on PrestaShop with Multistore function. I want add "noindex, nofollow" to one of my stores. I have main shop: eg. www.shop.com and second shop eg. www.shop.com/shop2. I want add "noindex, ...
0
votes
2
answers
607
views
Prevent Search Engines From Crawling Specific Webpage
I have a web-page on which users can fill some data and to do so they need to be logged in. So, when I created the sitemap.xml using xml-sitemaps.com it created several locs asking for login first. ...
user9649287
0
votes
1
answer
83
views
meta-robots in auth.php which is included in login.php
If I put
<meta name="robots" content="noindex,nofollow" />
in auth.php and include auth.php inside login.php page, the login.php page will not appear on Google or only auth.php won't appear?
- 19
1
vote
3
answers
3k
views
Using X-Robot-Tag in.htaccess - Wordpress to no index query string
I have looked at other questions on here regarding using the X-Robot-Tag to noindex a specific page on .htaccess.
My question is similar, although I would like to noindex a group of pages and am ...
- 295
0
votes
1
answer
1k
views
wordpress - How to noindex plugin folders, but not block them
I've searched but haven't found quite what I need. What I'm trying to do is noindex a plugin folders. Google for some reason has indexed a bunch of urls like this for example: /wp-content/plugins/...
- 613
4
votes
3
answers
3k
views
How to tell Jekyll to hide one page from search engines?
I have a website consisting of my public profile, made in Jekyll.
It also contains one page, say 'details.html', which contains more personal information about me. I want only those people to see ...
- 1,732
0
votes
1
answer
3k
views
Adding noindex tags in Prestashop
I need to add noindex tags for filters and I am not sure which files should I edit in Prestashop (1.6). Is it pagination.tpl or some other file? Also, how should I format the command?
Appreciate all ...
- 11