Web based family history software

Question 2 million individuals - Best DB?

  • donaldr
  • Topic Author
  • Offline
  • New Member
  • New Member
More
1 year 3 weeks ago #1 by donaldr
2 million individuals - Best DB? was created by donaldr
Hello,

Using the latest version of webtrees, our installation has a total of 2 million individuals ( 2 093 926 ), which include 832 353 families. Understandably, the searches are about 30 seconds with MariaDB. Wanted to try Microsoft SQL Server but it seems limited with webtrees at the moment. Can anyone suggest anything? Is this the best product to display via the web our records?

Thanks in advance,
Donald

Please Log in or Create an account to join the conversation.

More
1 year 2 weeks ago #2 by fisharebest
Replied by fisharebest on topic 2 million individuals - Best DB?
> Understandably, the searches are about 30 seconds with MariaDB

The "general search" simply does a full table scan of some tables.

I doubt the choice of DB engine is signifacant.

Most likely, you just need to give more RAM to MariaDB.

Greg Roach - greg@subaqua.co.uk - @fisharebest@phpc.social - fisharebest.webtrees.net

Please Log in or Create an account to join the conversation.

More
1 year 2 weeks ago #3 by fisharebest
Replied by fisharebest on topic 2 million individuals - Best DB?
PS - I know a site with approx 10M records which switched from SqlServer to MySQL

Greg Roach - greg@subaqua.co.uk - @fisharebest@phpc.social - fisharebest.webtrees.net

Please Log in or Create an account to join the conversation.

  • donaldr
  • Topic Author
  • Offline
  • New Member
  • New Member
More
1 year 2 weeks ago #4 by donaldr
Replied by donaldr on topic 2 million individuals - Best DB?
Thank you so much for taking the time to answer my question. Much appreciated!

Please Log in or Create an account to join the conversation.

More
1 year 2 weeks ago #5 by fisharebest
Replied by fisharebest on topic 2 million individuals - Best DB?
Also, the privacy rules might be slowing things down for you.

If all your data is public (or you can create a filtered export), you can disable the checks which csn make a significant difference.

Greg Roach - greg@subaqua.co.uk - @fisharebest@phpc.social - fisharebest.webtrees.net

Please Log in or Create an account to join the conversation.

  • donaldr
  • Topic Author
  • Offline
  • New Member
  • New Member
More
1 year 2 weeks ago #6 by donaldr
Replied by donaldr on topic 2 million individuals - Best DB?
That is interesting. Did not realize this fact. I thought the default indexes would take into account the privacy settings. Will certainly look into this.

In our case, the records have been donated to us. We do give access to the general public, We only give access to visitors through our kiosks that are onsite. The kiosks are firewalled as well.

So in this case, Is there a function that I could make all records remove the privacy settings?

Please Log in or Create an account to join the conversation.

More
1 year 2 weeks ago #7 by fisharebest
Replied by fisharebest on topic 2 million individuals - Best DB?
Privacy filtering happens after searching.

Control panel - family tree - privacy - living individuals - show to.public

(or similar. can't check right now)

Greg Roach - greg@subaqua.co.uk - @fisharebest@phpc.social - fisharebest.webtrees.net

Please Log in or Create an account to join the conversation.

  • donaldr
  • Topic Author
  • Offline
  • New Member
  • New Member
More
1 year 2 weeks ago #8 by donaldr
Replied by donaldr on topic 2 million individuals - Best DB?
Found it!

Thanks again!

Please Log in or Create an account to join the conversation.

Powered by Kunena Forum