Question Sitemaps

I can create a sitemap: [url] hermsdoerfer.familyds.com/webtrees/sitemap.xml [/url]
The preferences for the module ‘Sitemaps’ have been updated.

I cannot tell search engines that sitemaps are  are available. I get error messages.

• Bing/Yahoo

• Google

Thanks

Dietmar

hermsdoerfer.familyds.com/webtrees/
webtrees 2.1.20 | PHP 8.2.21 | MariaDB 10.3.37 | Apache 2.4.57 | Synology DS223 | DSM 7.2

You have inluded a "Sitemap" entry in your robots.txt file

hermsdoerfer.familyds.com//robots.txt

This should be sufficient.

Why do you think it is not working?

I have deleted the entry in robots.txt:  hermsdoerfer.familyds.com//robots.txt  
But there no entry for the sitemap.xml.

I see the sitemap.xml: [url] hermsdoerfer.familyds.com/webtrees/sitemap.xml [/url]

Via Bing/Yahoo ( www.bing.com/webmaster/ping.aspx?siteMap...btrees%2Fsitemap.xml ) 
I get in FIREFOX a blank page and in EDGE a error message (This page of www.bing.com was not found).

Via Google ( www.google.com/webmasters/tools/ping?sit...btrees%2Fsitemap.xml )
I get in FIREFOX and in EDGE a error message (Sitemaps ping is deprecated. See developers.google.com/search/blog/2023/06/sitemaps-lastmod-ping . Error 404).

Many thanks for your support
Dietmar

The two URLs under sitemaps do not work

• Bing/Yahoo
• Google

I either get an empty screen or an error message (Sitemaps ping is deprecated. See developers.google.com/search/blog/2023/06/sitemaps-lastmod-ping . Error 404)

hermsdoerfer.familyds.com/webtrees/
webtrees 2.1.20 | PHP 8.2.21 | MariaDB 10.3.37 | Apache 2.4.57 | Synology DS223 | DSM 7.2

See this:
github.com/fisharebest/webtrees/issues/4772

You should ignore those URLs.

Dietmar,

Please have a look at your /webtrees/robots.txt file. Consider copying parts to the robots.txt in the root folder. Only that file is used by robots.

It starts with listing bots that should stay away from your site (disallow: / )
Then it includes some disallow lines for others. These are resource intensive pages which robots should stay away from.

In general the style of selectively disallowing is to be preferred. But you are the webmaster, so it's your call.

If the two URLs have not been correct since last year, they could be removed. Then there will be no unnecessary inquiries.
Thank you very much
Dietmar

URLs removed from where exactly?

It is your responsibility to guide crawlers to what pages they may visit. A proper robots.txt and sitemap is essential in that process.

developers.google.com wrote: _
Submit your sitemap to Google
Keep in mind that submitting a sitemap is merely a hint: it doesn't guarantee that Google will download the sitemap or use the sitemap for crawling URLs on the site. There are a few different ways to make your sitemap available to Google.

• Submit a sitemap in Search Console using the Sitemaps report. This will allow you to see when Googlebot accessed the sitemap and also potential processing errors.
• Use the Search Console API to programmatically submit a sitemap.
• Insert the following line anywhere in your robots.txt file, specifying the path to your sitemap. We will find it the next time we crawl your robots.txt file:
  
  Code:

  Sitemap: https://example.com/my_sitemap.xml

Further on:

Important:
This report shows only sitemaps that were submitted using this report or the API. It does not show any sitemaps discovered through a robots.txt reference or other discovery methods. However, even if Google has already discovered a sitemap through other means, you can still submit it using this report in order to track our success and error rates.

By trying a search on "Anton Martin Hermsdörfer" it appears that the major search engines all know about your website. So it gets crawled regularly. So you don't need to submit anything. That's only needed for new or drastically changed websites.

I mean this page. The links on Bing and Google are incorrect (see attachment)

webtrees used the information from this page.

en.wikipedia.org/wiki/Sitemaps#Search_engine_submission

Perhaps someone should update it

I'll remove the links from webtrees...