This Help forum is for issues relates to the latest release (1.7.10/11/12). For issues related to development versions please use their own Help forum.
Before asking for help please read "How to request help" by clicking on that tab above here."

TOPIC: Remove pages from search index

Remove pages from search index 2 months 3 weeks ago #1

  • ChrisAndersen
  • ChrisAndersen's Avatar
  • Offline
  • New
  • Greetings from Århus, Denmark
  • Posts: 55
Little issue? ;-)
I'm sure I'm not the first and there is an easy solution for this.

Just checked my site on Google.
Getting results like this:
genroot.me/1/module.php?mod=descendancy&...scendants&xref=I1222
genroot.me/1/module.php?mod=families&mod_action=ajax&alpha=I
genroot.me/1/module.php?mod=descendancy&...scendants&xref=I1225
genroot.me/1/module.php?mod=families&mod_action=ajax&alpha=K

These pages have no working links, but that's not the problem. Sites like that I wouldn't like on G.
These pages are a kind of disadvantage in the search indexes.

Actually, I would think: Remove directory from G-index.
But are these directories? How would a removal URL look like to delete these files from G.s index.
How do I remove these sites?
genroot.me (blushing)
================
(wt 1.7.12 | php 7.2.13)
Last Edit: 2 months 3 weeks ago by ChrisAndersen.
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #2

  • fisharebest
  • fisharebest's Avatar
  • Offline
  • Administrator
  • Posts: 11054
robots.txt
Greg Roach - This email address is being protected from spambots. You need JavaScript enabled to view it. - fisharebest.webtrees.net
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #3

  • ChrisAndersen
  • ChrisAndersen's Avatar
  • Offline
  • New
  • Greetings from Århus, Denmark
  • Posts: 55
cool...
found the example robots.txt
thx... done :-)

You wrote:
Tell the search engines what is important
There are two ways to go about this:
Tell them specifically what NOT TO index (using http headers, robots meta tags, and robots.txt)
Tell them specifically what TO index (using sitemap.xml)

Does it mean that I can use the sitemap.xml to handle the WP part and the robot.txt is handling the WT part?
genroot.me (blushing)
================
(wt 1.7.12 | php 7.2.13)
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #4

  • fisharebest
  • fisharebest's Avatar
  • Offline
  • Administrator
  • Posts: 11054
You can have more than one sitemap file per site.

You can use the WT sitemap *and* the WP sitemap at the same time.
Greg Roach - This email address is being protected from spambots. You need JavaScript enabled to view it. - fisharebest.webtrees.net
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #5

  • ChrisAndersen
  • ChrisAndersen's Avatar
  • Offline
  • New
  • Greetings from Århus, Denmark
  • Posts: 55
Thx for the helping hint :-)

You wrote:
Action
webtrees includes a Sitemap module that works well for small to medium family trees, but it will probably timeout on larger trees.

Where can I find this sitemap.xml? What's the URL?
...cannot find it on the root. Would I just create a new one there?
genroot.me (blushing)
================
(wt 1.7.12 | php 7.2.13)
Last Edit: 2 months 3 weeks ago by ChrisAndersen.
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #6

  • HRN
  • HRN's Avatar
  • Offline
  • Senior
  • Posts: 323
Control panel -> Module administration -> Sitemaps
webtrees 1.7.14 at visitusinmaputo.com/webtree PHP 7.2.9 (Modules: vytux_cousins, vytux_pages, fancy_treeview, ancestral-fan-chart)
webtrees 2.0 dev on local WampServer PHP 7.3.1
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #7

  • ChrisAndersen
  • ChrisAndersen's Avatar
  • Offline
  • New
  • Greetings from Århus, Denmark
  • Posts: 55
I run version 1.7.12
PHP 7.2.13

no sitemaps there... the last item is Journal
See attachment.
genroot.me (blushing)
================
(wt 1.7.12 | php 7.2.13)
Last Edit: 2 months 3 weeks ago by ChrisAndersen. Reason: perhaps PHP version helps?
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #8

  • HRN
  • HRN's Avatar
  • Offline
  • Senior
  • Posts: 323
There should be more modules. Looks like the page did not load completely
webtrees 1.7.14 at visitusinmaputo.com/webtree PHP 7.2.9 (Modules: vytux_cousins, vytux_pages, fancy_treeview, ancestral-fan-chart)
webtrees 2.0 dev on local WampServer PHP 7.3.1
The administrator has disabled public write access.
Do you need a web hosting solution for your webtrees site?
If you prefer a host that specialises in webtrees, the following page lists some suppliers able to provide one for you: 

Remove pages from search index 2 months 3 weeks ago #9

  • ChrisAndersen
  • ChrisAndersen's Avatar
  • Offline
  • New
  • Greetings from Århus, Denmark
  • Posts: 55
Thx for asking :-)
Page loaded fully with the latest Chrome for Windows10.
Also tried with the latest Safari on iPad... the same.
I'm really excited, what other modules there are after J as Journal.

Which php file is responsable for this site?
Would I just replace the new one in 1.7.12 with an old from the 1.7.11 version?
genroot.me (blushing)
================
(wt 1.7.12 | php 7.2.13)
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #10

  • fisharebest
  • fisharebest's Avatar
  • Offline
  • Administrator
  • Posts: 11054
Looking at the picture of the incomplete page, I'm guessing that if you look at the page source (e.g. CRTL-U in most browsers), you'll see a helpful error message at the bottom.
Greg Roach - This email address is being protected from spambots. You need JavaScript enabled to view it. - fisharebest.webtrees.net
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #11

  • bertkoor
  • bertkoor's Avatar
  • Offline
  • Gold
  • Greetings from Utrecht, Holland
  • Posts: 1547
After Journal comes Lifespan. I think the admin panel just iterates over the content of the modules folder. So look there first.

Maybe you have an old incompatible module with name starting with K or L throwing an error.
stamboom.BertKoor.nl runs on webtrees v1.7.9
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #12

  • ChrisAndersen
  • ChrisAndersen's Avatar
  • Offline
  • New
  • Greetings from Århus, Denmark
  • Posts: 55
fisharebest wrote:
Looking at the picture of the incomplete page, I'm guessing that if you look at the page source (e.g. CRTL-U in most browsers), you'll see a helpful error message at the bottom.

Thx for your answer. I think there is an error but I still don't know what to do.
Here is the source code from "Journal" down:
<tr>
                    <td class="text-center">
                        <input type="hidden" id="status-user_blog" name="status-user_blog" value="1"><input type="checkbox" name="status-user_blog-GUI-ONLY" value="1" checked onclick="document.getElementById('status-user_blog').value=(this.checked?1:0);" >                    </td>
                    <td>
                                                    Journal                                                                    </td>
                    <td>
                        A private area to record notes or keep a journal.                                            </td>
                    <td class="text-center text-muted hidden-xs">
                                                    -
                                            </td>
                    <td class="text-center text-muted hidden-xs">
                                                    -
                                            </td>
                    <td class="text-center text-muted hidden-xs">
                                                    -
                                            </td>
                    <td class="text-center text-muted hidden-xs">
                                                                                    <i class="fa fa-user" title="My page"></i>
                                                                                        <i class="fa fa-tree" title="Home page"></i>
                                                                        </td>
                    <td class="text-center text-muted hidden-xs">
                                                    -
                                            </td>
                    <td class="text-center text-muted hidden-xs">
                                                    -
                                            </td>
                    <td class="text-center text-muted hidden">
                                                    -
                                            </td>
                </tr>
                            <tr>
                    <td class="text-center">
                        <input type="hidden" id="status-justlight_theme_options" name="status-justlight_theme_options" value="0"><input type="checkbox" name="status-justlight_theme_options-GUI-ONLY" value="1" onclick="document.getElementById('status-justlight_theme_options').value=(this.checked?1:0);" >                    </td>
                    <td>
                                                    <a href="</main><footer></footer><!--[if lt IE 9]><script src="packages/jquery-1.12.1/jquery.min.js"></script><![endif]--><!--[if gte IE 9]><!--><script src="packages/jquery-2.2.1/jquery.min.js"></script><!--<![endif]--><script src="packages/jquery-ui-1.11.4/js/jquery-ui.min.js"></script><script src="assets/js-1.7.9/webtrees.js"></script><script>
			var WT_STATIC_URL  = "";
			var WT_MODULES_DIR = "modules_v3\x2F";
			var WT_GEDCOM      = "tree1";
			var textDirection  = "ltr";
			var WT_SCRIPT_NAME = "admin_modules.php";
			var WT_LOCALE      = "en\x2DUS";
			var WT_CSRF_TOKEN  = "wfZoaGOXv1hV5y94k7lNFXiDJ1vSkpaP";
		</script><script src="packages/datatables-1.10.7/js/jquery.dataTables.min.js"></script><script src="packages/datatables-1.10.7/plugins/dataTables.bootstrap.js"></script><script>
		function reindexMods(id) {
			jQuery("#" + id + " input").each(
				function (index, value) {
					value.value = index+1;
				});
		}
		jQuery("#installed_table").dataTable( {
			paging: false,
			"language": { "paginate": {  "first":    "first",  "last":     "last",  "next":     "next",  "previous": "previous" }, "emptyTable":     "No records to display", "info":           "Showing _START_ to _END_ of _TOTAL_", "infoEmpty":      "Showing 0 to 0 of 0", "infoFiltered":   "(filtered from _MAX_ total entries)", "infoPostfix":    "", "lengthMenu":     "Display \x3Cselect\x3E\x3Coption value\x3D\x2210\x22\x3E10\x3C\x2Foption\x3E\x3Coption value\x3D\x2220\x22\x3E20\x3C\x2Foption\x3E\x3Coption value\x3D\x2230\x22\x3E30\x3C\x2Foption\x3E\x3Coption value\x3D\x2250\x22\x3E50\x3C\x2Foption\x3E\x3Coption value\x3D\x22100\x22\x3E100\x3C\x2Foption\x3E\x3Coption value\x3D\x22\x2D1\x22\x3EAll\x3C\x2Foption\x3E\x3C\x2Fselect\x3E", "loadingRecords": "Loading…", "processing":     "Loading…", "search":         "Filter", "url":            "", "zeroRecords":    "No records to display"},
			sorting: [[ 1, "asc" ]],
			columns : [
				{ sortable: false, class: "center" },
				null,
				null,
				{ class: "center" },
				{ class: "center" },
				{ class: "center" },
				{ class: "center" },
				{ class: "center" },
				{ class: "center" },
				{ class: "center", visible: false } // The Module system does not yet include themes
			]
		});
	</script><script src="packages/bootstrap-3.3.6/js/bootstrap.min.js"></script></body></html>
<!-- webtrees: 1.7.12 --><!-- Execution time: 0.05 seconds --><!-- Memory: 4,096 KB --><!-- SQL queries: 157 -->
genroot.me (blushing)
================
(wt 1.7.12 | php 7.2.13)
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #13

  • ChrisAndersen
  • ChrisAndersen's Avatar
  • Offline
  • New
  • Greetings from Århus, Denmark
  • Posts: 55
bertkoor wrote:
I think the admin panel just iterates over the content of the modules folder. So look there first.
Maybe you have an old incompatible module with name starting with K or L throwing an error.

Thx for the answer.
I don't really know what you mean. Can you explain?
I'm also not quite sure, if I could have an old module, because it is my first installation of WT, overall.
genroot.me (blushing)
================
(wt 1.7.12 | php 7.2.13)
The administrator has disabled public write access.

Remove pages from search index 2 months 3 weeks ago #14

  • fisharebest
  • fisharebest's Avatar
  • Offline
  • Administrator
  • Posts: 11054
Thanks for the information.

You have installed a third-party module "justlight_theme_options".

The error is occuring while processing some code in that module.

I guess you upgraded webtrees, but did not upgrade your third-party modules.

If you *are* using the very latest version of justlight_theme_options, then you need to contact the author of that for support.
Greg Roach - This email address is being protected from spambots. You need JavaScript enabled to view it. - fisharebest.webtrees.net
The administrator has disabled public write access.
Powered by Kunena Forum