Important Search algorythm has changed ??
- bertkoor
- Offline
- Platinum Member
- Greetings from Utrecht, Holland
- make a GEDCOM export from your main tree.
- import the exported GEDCOM file in a new tree
- test in the new tree
Sometimes database indexes can become somewhat corrupted and need to be rebuilt, especially when the database is in use over several years.
I would actually advise to drop the database and start fresh with only a GEDCOM import, but that could have too much impact for you.
Data not stored in GEDCOM, such as users, would be lost.
stamboom.BertKoor.nl runs on webtrees v1.7.13
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
In fact I use webtrees since the beginning of it's development from PhpGedView.
But I often restartet with a fresh database.
Last time very recently when migrating to V2.0.1
The users can be restored, too. That's really not the problem.
A 1:1 copy of the Gedcom works fine in a V1.7.17 environment.
So I will try to re-import the Gedcom to a new fresh tree and test it.
I created the new tree with the re-imported Gedcom and tried to repeat the search for "Andreas Hoffmann Schubert".
What a surprise. Here I receive either 14 FAM records or none. No importance whether I'm searching in the Test tree or Le Grand Arbre Commun
By the way, the same search in webtrees 1.7.17 gives the correct number of no results.
wt1.rauhut.eu/search.php?action=header&g...nn+Schubert+&x=0&y=0
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
I start to think that searching for persons or families is simply not possible with V2.x .
Let me give you an exemple:
When I am looking for families with the names LEHMANN and RAUHUT with simple search by entering the two names I get
1 Individual & 1554 families
When looking only for LEHMANN I get
24 individuals & 15 families
Within these 15 families I detected 4 couples of LEHMANN & RAUHUT as bride and groom.
Please try to explain this behavior.
Is there a limit in the numbers of records to be searched ? stats
By the way webtrees 1.7.17 is giving the good answer
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- fisharebest
- Away
- Administrator
wt.rauhut.eu/tree/GAC.ged/search-general?query=LEHMANN%20RAUHUT&search_individuals=0&search_families=1&search_repositories=0&search_sources=0&search_notes=0&search_trees%5B0%5D=GAC.ged
You are saying that there are others?
Can you give the URL of one that is missing?
Greg Roach - greg@subaqua.co.uk - @fisharebest@phpc.social - fisharebest.webtrees.net
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
I believe, that I have to repeat my searches at least two times and it might be that it is related to the errors in the web log.
I see very often this kind of error.
What can I do against this ?
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- fisharebest
- Away
- Administrator
Your webhost has created a limit on the number of database connections that you can make.
If you have lots of visitors, then this will create lots of database requests.
Perhaps you have a lot of human visitors - or perhaps you have a lot of robot visitors.
Greg Roach - greg@subaqua.co.uk - @fisharebest@phpc.social - fisharebest.webtrees.net
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
And probably these errors are the reason for the unpredictable results of my searcxh queries.
Is there a way to see who or what is creating these requests ?
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- fisharebest
- Away
- Administrator
Greg Roach - greg@subaqua.co.uk - @fisharebest@phpc.social - fisharebest.webtrees.net
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
And how can I get rid of them ? Many IP adresses and search engin names appear really often.
Is there a list of undesired bots or IP adresses, where I can add manually all these unwanted guests ?
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- ddrury
- Offline
- Senior Member
Read all of it including the comments, scroll down until you hit the comment with
in it. for the best syntax to useSetEnvIfNoCase User-Agent (libwww-perl|wget|LieBaoFast|Mb2345Browser|zh-CN) bad_bot
BTW you must be able to edit .htaccess
--
Dave
Local: Win 11 Pro, WSL2/Ubuntu20.04.4, Apache 2.4.51, PHP 7.4.26/8.1.7, MySQL 8.0.27
Production: Litespeed 8.0.1, PHP 8.1.9, MySQL 8.0.26
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
Where can I find robots.txt in my installation?fisharebest wrote:
1) delete any existing robots.txt
2) obtain the default by visiting your-site/robots.txt
3) copy/paste the text into your own robots.txt
4) edit the file to add your own rule.
There is none in the root that I can delete. (
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
I'll read it carefully, trying to understand it.ddrury wrote: This is quite useful
Read all of it including the comments, scroll down until you hit the comment within it. for the best syntax to useSetEnvIfNoCase User-Agent (libwww-perl|wget|LieBaoFast|Mb2345Browser|zh-CN) bad_bot
BTW you must be able to edit .htaccess
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
But the search for lehmann rauhut gives my the same bad result.
Only when I restart the search a second time it gives me the correct result of 1 IND and 4 FAM records
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
Andreas wrote: I modified my .htaccess file and for the moment I have no error messages in the webtrees log.
And now the bot is angry. I had about 1500 error statements in less than half an hour (2021-02-08 12:39:04 - 2021-02-08 12:58:02) in the webtrees log
The access-log of the server told me that one IP 27.110.165.84 accessed all my websites for more than one hour between 08/Feb/2021:12:31:41 +0100 and 08/Feb/2021:13:28:11 +0100
Is there someone, who can help me ?
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- Sir Peter
- Offline
- Senior Member
- Posts: 487
The attack seems to come from
Then add a line like this to the config.ini.php and see whether it helps.
Please let us know whether it worked.
Peter
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
for giving me that link to Gregs information how to block a network.
The string was added to my config.ini.php. I don't have too much active human users in Indonesia.
But I have to block them in the root of my server space.
From this adress came requests also to all of my other websites.
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.
- Sir Peter
- Offline
- Senior Member
- Posts: 487
Peter
Please Log in or Create an account to join the conversation.
- Andreas
- Topic Author
- Offline
- Premium Member
I'm dealing with the .htaccess files in each root directory.
But I don't give up.
Both MAUPILLÉ & RAUHUT families are using webtrees V2.1.18
Please Log in or Create an account to join the conversation.