<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class="">We are about to hit 25K sites on a multisite install; we also use domain mapping. We found that so far we haven’t needed to shard the database. As long as your database server can handle that volume/load then you will be fine. A database this large does require doing some things differently. Our production sysadmin switched to using the percona tools for backup quickly and we had also looked at doing LVM snapshots which would have also been a good solution. All tables are innodb be default and we use hyperdb to manage the load between a single master and several slave/read databases. </div><div class=""><br class=""></div><div class="">We also use memcache, probably soon redis, to handle the WP Object Cache. This helps greatly with logged in users, as a single page load can be taken from 100+ sql queries to build down to less than 10 on each load. For anonymous user caching we use two varnish servers on the frontend to manage that load, balanced between four web servers.</div><div class=""><br class=""></div><div class="">We are working an management tools to start pruning old sites, as usually this seems to be hindsight, that will look for discontinued student/staff accounts and start to disable/delete/archive them from the system.</div><div class=""><br class=""></div><div class="">Jason</div><br class=""><div class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div class="">p: (814) 865-1840, c: (814) 777-7665<br class="">Systems Administrator<br class="">Teaching and Learning with Technology, Information Technology Services<br class="">The Pennsylvania State University</div></span>
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On Mar 13, 2015, at 10:23 AM, Michael Barnard <<a href="mailto:mbarnard@mtholyoke.edu" class="">mbarnard@mtholyoke.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">I'm curious about the need for HyperDB and its ilk. I'm at Mount Holyoke College now, but I used to maintain a large Wordpress installation for UMass Amherst. It was backed by MySQL using MyISAM tables and, when it was handed to me, it had been running for several years and never had any blogs deleted from it. I seem to recall there being something on the order of 10,000+ blogs, with 9 database tables per blog and three files per table, so a couple hundred thousand files in total. Many (most?) of these were abandoned, but they still saw some traffic from spammers and crawlers. Surprisingly, we had no significant performance problems with this installation, and we never considered doing any kind of database sharding. The one problem we did run into was with mysqldump - there were just too many tables for it to cope with, so it couldn't dump the Wordpress database at all. I didn't really ever need SQL dumps of Wordpress, though - I dealt with backups using LVM snapshots, for example. In any case, I never ran up on any kind of limit on the total number of tables per database. Is that an InnoDB thing?<div class=""><br class=""></div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Fri, Mar 13, 2015 at 9:49 AM, Joseph Ugoretz <span dir="ltr" class=""><<a href="mailto:joseph.ugoretz@mhc.cuny.edu" target="_blank" class="">joseph.ugoretz@mhc.cuny.edu</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="auto" class="">
<div class="">D'Arcy, what numbers are you at now? We aren't seeing performance problems yet at 4,000 sites but I expect to go to hyperdb soon. </div>
<div class=""><br class="">
</div>
<div class="">I think my colleague Luke at Baruch College (10,000 or so sites) is using SharDB. <br class="">
<br class="">
<div class=""><span style="background-color:rgba(255,255,255,0)" class="">-- <br class="">
Joseph Ugoretz, PhD</span></div>
<span style="background-color:rgba(255,255,255,0)" class="">Associate Dean<br class="">
Teaching, Learning and Technology<br class="">
Macaulay Honors College, CUNY<br class="">
<a class="">35 West 67th St.</a><br class="">
<a class="">New York, New York 10023</a><br class="">
<a href="tel://212-729-2920" target="_blank" class="">212-729-2920</a></span></div>
<div class=""><br class="">
On Mar 13, 2015, at 9:26 AM, D'Arcy L Norman <<a href="mailto:dlnorman@ucalgary.ca" target="_blank" class="">dlnorman@ucalgary.ca</a>> wrote:<br class="">
<br class="">
</div>
<blockquote type="cite" class="">
<div class="">
<div style="direction: ltr; font-family: Tahoma; font-size: 10pt;" class="">The biggest tweak you can do is add database scaling, so you don't hit the max-tables limit in a single database. HyperDB or MultiDB would do that - I use MultiDB on
<a href="http://ucalgaryblogs.ca/" target="_blank" class="">UCalgaryBlogs.ca</a> and it works great. Spreads the tables across several databases (16, 256 or 4096), which can hold up to "millions" of blog sites. Haven't had enough to test that claim, though. The 16 database config scales
to 50,000 blogs. That should hold us for a few years.
<div class=""><br class="">
</div>
<div class="">Multi-DB: <a href="https://premium.wpmudev.org/project/multi-db/" target="_blank" class="">https://premium.wpmudev.org/project/multi-db/</a></div>
<div class=""><br class="">
</div>
<div class="">HyperDB: <a href="https://wordpress.org/plugins/hyperdb/" target="_blank" class="">https://wordpress.org/plugins/hyperdb/</a></div>
<div class=""><br class="">
</div>
<div class="">I started with MultiDB, back before HyperDB was a thing. If I was starting fresh, I'd go with HyperDB because it's free, maintained by Automattic, and basically what's used on
<a href="http://wordpress.com/" target="_blank" class="">WordPress.com</a>. MultiDB woks find, but requires a subscription fee. I haven't had the energy to migrate UCalgaryBlogs to it, because it works.</div>
<div class=""><br class="">
</div>
<div class="">- D</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<div style="font-family: 'Times New Roman'; font-size: 16px;" class="">
<hr class="">
<div style="direction:ltr" class=""><font face="Tahoma" class=""><b class="">From:</b> wp-edu [<a href="mailto:wp-edu-bounces@lists.automattic.com" target="_blank" class="">wp-edu-bounces@lists.automattic.com</a>] on behalf of Joseph Ugoretz [<a href="mailto:joseph.ugoretz@mhc.cuny.edu" target="_blank" class="">joseph.ugoretz@mhc.cuny.edu</a>]<br class="">
<b class="">Sent:</b> March 13, 2015 06:48 AM<br class="">
<b class="">To:</b> Low-traffic list discussing WordPress in education.<br class="">
<b class="">Subject:</b> Re: [wp-edu] How do you manage a site with 100+ sub sites with WordPress?<br class="">
</font><br class="">
</div>
<div class=""></div>
<div class="">
<div class="">These are class sites and student eportfolios, so we do not ever retire or purge sites. </div>
<div class=""><br class="">
</div>
<div class="">Students do return to old sites and take them up again even if they have been inactive for a long time, even years. </div>
<div class=""><br class="">
</div>
<div class="">Part of our policy and what we guarantee to students is that these sites will remain available until and unless the students themselves delete them (except in the case of serious violations of our community guidelines...has not happened yet). </div>
<div class=""><br class="">
</div>
<div class="">Joe<br class="">
<div class=""><span class="">-- <br class="">
Joseph Ugoretz, PhD</span></div>
<span class="">Associate Dean<br class="">
Teaching, Learning and Technology<br class="">
Macaulay Honors College, CUNY<br class="">
<a href="http://urlblockederror.aspx/" target="_blank" class="">35 West 67th St.</a><br class="">
<a href="http://urlblockederror.aspx/" target="_blank" class="">New York, New York 10023</a><br class="">
<a href="tel://212-729-2920" target="_blank" class="">212-729-2920</a></span></div>
<div class=""><br class="">
On Mar 13, 2015, at 1:47 AM, Hugh Paterson III <<a href="mailto:hugh@thejourneyler.org" target="_blank" class="">hugh@thejourneyler.org</a>> wrote:<br class="">
<br class="">
</div>
<blockquote type="cite" class="">
<div class="">What sort of site retirement policy do you maintain? How do admin know when to purge a site from a set of 4,000?
<div class=""><br class="">
</div>
<div class="">- Hugh Paterson III<br class="">
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
<div class="">
<div class="">On Mar 12, 2015, at 4:37 PM, Joseph Ugoretz <<a href="mailto:joseph.ugoretz@mhc.cuny.edu" target="_blank" class="">joseph.ugoretz@mhc.cuny.edu</a>> wrote:</div>
<br class="">
<blockquote type="cite" class="">
<div dir="auto" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" class="">
<div class="">WordPress multisite works very well for this. We currently have, on our big multisite install, over 4,000 sites, with many different themes. We aren't currently using domain mapping but may soon. </div>
<div class=""><br class="">
</div>
<div class="">My CUNY colleagues at Baruch College have a similar set up with far more sites. <br class="">
<br class="">
<div class=""><span class="">-- <br class="">
Joseph Ugoretz, PhD</span></div>
<span class="">Associate Dean<br class="">
Teaching, Learning and Technology<br class="">
Macaulay Honors College, CUNY<br class="">
<a href="http://urlblockederror.aspx/" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">35 West 67th St.</a><br class="">
<a href="http://urlblockederror.aspx/" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">New York, New York 10023</a><br class="">
<a href="tel://212-729-2920" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">212-729-2920</a></span></div>
<div class=""><br class="">
On Mar 12, 2015, at 7:26 PM, Mcmillan, Scott <<a href="mailto:scott.mcmillan@ubc.ca" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">scott.mcmillan@ubc.ca</a>> wrote:<br class="">
<br class="">
</div>
<blockquote type="cite" class="">
<div style="direction:ltr;font-family:Tahoma;font-size:10pt" class="">Hi Ryan,
<div class=""><br class="">
</div>
<div class="">On the UBC CMS we have just over 900 domain mapped sites.</div>
<div class="">We run one Network within multi site and <span style="font-size:10pt" class="">have one central theme and allow users to map their domains using the Domain Mapping Plugin. </span></div>
<div class=""><span style="font-size:10pt" class=""><br class="">
</span></div>
<div class="">It's worked well for users so far. </div>
<div class=""><br class="">
</div>
<div class=""><span style="font-size:10pt" class="">-Scott</span></div>
<div class="">
<div style="font-family:'Times New Roman';font-size:16px" class="">
<hr class="">
<div style="direction:ltr" class=""><font face="Tahoma" class=""><b class="">From:</b><span class=""> </span>wp-edu [<a href="mailto:wp-edu-bounces@lists.automattic.com" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">wp-edu-bounces@lists.automattic.com</a>]
on behalf of Ryan Kite [<a href="mailto:rkite@yvcc.edu" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">rkite@yvcc.edu</a>]<br class="">
<b class="">Sent:</b><span class=""> </span>Thursday, March 12, 2015 3:46 PM<br class="">
<b class="">To:</b><span class=""> </span><a href="mailto:wp-edu@lists.automattic.com" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">wp-edu@lists.automattic.com</a><br class="">
<b class="">Subject:</b><span class=""> </span>[wp-edu] How do you manage a site with 100+ sub sites with WordPress?<br class="">
</font><br class="">
</div>
<div class=""></div>
<div class="">
<div class="">
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif" class="">
We are looking at going with WordPress with at our college, currently have about 100+ sub sites under one master, each with unique navigation and content.</div><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
</p>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif" class="">
How do you manage this in WordPress?</div><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
</p><p class="MsoNormal" style="margin:0in 0in 12pt;font-size:11pt;font-family:Calibri,sans-serif;background-color:white">
<b class=""><span style="font-size:10pt;font-family:'Segoe UI',sans-serif" class="">Ryan Kite<br class="">
</span></b><span style="font-size:10pt;font-family:'Segoe UI',sans-serif" class="">Web Designer<br class="">
<a href="tel:509.574.4788" value="+15095744788" target="_blank" class="">509.574.4788</a> |<span class=""> </span><a href="mailto:rkite@yvcc.edu" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">rkite@yvcc.edu</a><br class="">
Yakima Valley Community College<br class="">
<span class=""><a href="http://www.linkedin.com/in/ryankite/" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">http://www.linkedin.com/in/ryankite/</a></span></span></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
</p>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<blockquote type="cite" class=""><span class="">_______________________________________________</span><br class="">
<span class="">wp-edu mailing list</span><br class="">
<span class=""><a href="mailto:wp-edu@lists.automattic.com" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">wp-edu@lists.automattic.com</a></span><br class="">
<span class=""><a href="http://lists.automattic.com/mailman/listinfo/wp-edu" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">http://lists.automattic.com/mailman/listinfo/wp-edu</a></span><br class="">
</blockquote>
_______________________________________________<br class="">
wp-edu mailing list<br class="">
<a href="mailto:wp-edu@lists.automattic.com" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">wp-edu@lists.automattic.com</a><br class="">
<a href="http://lists.automattic.com/mailman/listinfo/wp-edu" style="color:rgb(149,79,114);text-decoration:underline" target="_blank" class="">http://lists.automattic.com/mailman/listinfo/wp-edu</a></div>
</blockquote>
</div>
<br class="">
</div>
</div>
</div>
</blockquote>
<blockquote type="cite" class="">
<div class=""><span class="">_______________________________________________</span><br class="">
<span class="">wp-edu mailing list</span><br class="">
<span class=""><a href="mailto:wp-edu@lists.automattic.com" target="_blank" class="">wp-edu@lists.automattic.com</a></span><br class="">
<span class=""><a href="http://lists.automattic.com/mailman/listinfo/wp-edu" target="_blank" class="">http://lists.automattic.com/mailman/listinfo/wp-edu</a></span><br class="">
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<blockquote type="cite" class="">
<div class=""><span class="">_______________________________________________</span><br class="">
<span class="">wp-edu mailing list</span><br class="">
<span class=""><a href="mailto:wp-edu@lists.automattic.com" target="_blank" class="">wp-edu@lists.automattic.com</a></span><br class="">
<span class=""><a href="http://lists.automattic.com/mailman/listinfo/wp-edu" target="_blank" class="">http://lists.automattic.com/mailman/listinfo/wp-edu</a></span><br class="">
</div>
</blockquote>
</div>
<br class="">_______________________________________________<br class="">
wp-edu mailing list<br class="">
<a href="mailto:wp-edu@lists.automattic.com" class="">wp-edu@lists.automattic.com</a><br class="">
<a href="http://lists.automattic.com/mailman/listinfo/wp-edu" target="_blank" class="">http://lists.automattic.com/mailman/listinfo/wp-edu</a><br class="">
<br class=""></blockquote></div><br class=""></div>
_______________________________________________<br class="">wp-edu mailing list<br class=""><a href="mailto:wp-edu@lists.automattic.com" class="">wp-edu@lists.automattic.com</a><br class="">http://lists.automattic.com/mailman/listinfo/wp-edu<br class=""></div></blockquote></div><br class=""></body></html>