Blog Profile / mySQL DBA
| URL : | http://mysqldba.blogspot.com | |
|---|---|---|
| Filed Under: | Programming / Database Development | |
| Posts on Regator: | 103 | |
| Posts / Week: | 0.4 | |
| Archived Since: | June 30, 2008 | |
Blog Post Archive
In China and Spreading mySQL/MariaDB/XtraDB Ganglia, GearmanD, Memcache, MongoDB, HAProxy, Nginx, PHP, Python
I am currently in Beijing for a month as the VP of Technology for Fun+, a US/China based gaming company, spreading the joys of open-source I have an entire team to do benchmarks, study INNODB flushing, build new technologies, which I hope to open-source I will also post the results here. Show More Summary
How to pick indexes is the same for MongoDB as mySQL
I recently went to MongoDB Days, a conference about everything MongoDB in SF. Starting my career as a Systems Programmer then Web Developer, MySQL DB[Admin|Architect], to Software|System Architecture I like to keep an open mind about new technology and trends. Show More Summary
I'll be speaking at Percona Live April 24th in Ballroom F
WHEN YOU SCALE OUT HOW TO SCALE IN BY INCREASING DENSITY USING RAIDED SSD Sharding-splitting data for a single database server onto many database servers is a method to scale horizontally and is needed to get more disk IOPS from a mechanical harddrive server architecture. Show More Summary
Instant InnoDB by Matthew Reid Review
Instant InnoDB by PACKT publishing is 83 page book on getting a basic understanding of InnoDB. Enough of an understanding to know what questions to ask in the future. The book is not for intermediate or advance Innodb users. It has the basics to get you started. Show More Summary
Multi MySQL is perfect for SSDs and Removing Replication Lag
Ever run into a problem where an application's Master is accepting all the writes and the master's slaves lags? Ever had this same problem yet the Slave has a raid array of very fast SSDs? You must be thinking to yourself, "I call BS, Dathan; a SSD drive can do crazy IOPS". Show More Summary
Raid Stripe Size, Raid Stripe Segment Size the definition and SSD consideration
For years now I have been confusing Stripe Segment Size with Stripe Size, when configuring my RAID arrays. I always thought that Stripe Size is the number of KB of a file written per disk before moving to the next disk in the array.Show More Summary
A Case for Automation of OpenMMS for XTRADB Backups with Python
If you read my blog from time to time, you know I am a huge advocate of automating tasks. If I have to do something more then once I might was well automate the task. Currently at my new gig, we are using opennms. OpenNMS is a combo of Nagios, Ganglia talking over SNMP Java goodness. Show More Summary
mySQL Partitioning summary and what to watch out for
I have been looking for efficient ways to purge data from "Fast Disks" for applications that are time based and do not look at data after a time window has passed. For instance keeping a table where one stores log data from access logs and the data is okay to roll up the data and throw away the details every month. Show More Summary
Speeding up EC2 work by using AWS tools and scripts to bypass the AWS management console
Believe me managing EC2 instances is not as simple or magical as marketers would like for you to believe. The cloud gets complicated when it gets bigger. EC2 really only enables a person to ignore power, network layout (which is bad),...Show More Summary
mySQL 5.6 looks very promising
I have been doing some research lately on various mySQL related features and found myself distracted by mySQL 5.6. If everything that I am reading is correct, this should be the best mySQL version yet.mySQL 5.6 will have multi thread replication, making time delayed slaves-an actual feature and not a byproduct of replicating high write volumes. Show More Summary
Sizing EC2 Servers to get more Bang for the Buck
To launch an app there was a tried and true process. The process in the past was to rent a server in a managed hosting facility. Get a few more as you grow, then build a model showing that it would be cheaper to get your own cage and finance servers. Show More Summary
mySQL Shards, Gearman, rabbitMQ, NodeJS, JSONP Push for Fault Tollerant Realtime Notification Feed
Over the past few weeks, I have been tweaking my feed system to be truly real-time. The hypothesis is, if end users are pushed content without forcing them to refresh a page they will interact on the content-which in turn turns a consumer into a producer of content causing virality within subnetworks of the Graph. Show More Summary
Asyncronous Shard Queries in PHP using mysqlnd enabling the feed load 10 times faster.
A few years ago I wrote about Asynchronous Shard Queries verses Synchronous Shard Queries, and in this post I talked about having to write a server to handle this for me in Java. Now I do it in PHP and got great results that are posted below.Building the Feed was taking 100ms up to 40 seconds on the initial load, if the feed is out of cache. Show More Summary
SpyMemcached Transcoder with PHP PDO Objects using ZLIB
My technology stack services more then 2 Million Daily Active users. Its very basic. PHP talks to mySQL, Memcache, RabbitMQ, Gearman and Facebook. Now that we have more Java specifically to support our SmartFox Server and other services,...Show More Summary
Basic ETL with Gearman and MySQL in a few lines of PHP code
Gearman is awesome. If you do not know what it is, its a queue and load balancing system for an arbitrary number of workers which enables distributed computing across many nodes. Some of the same guys who worked on mySQL source worked...Show More Summary
mySQL Column Types and Why it Matters.
MySQL is awesome at converting stringsto integers when comparing column lvalues with converted rvalues. So much sothat many of us take this fact for granted. When does this assumption breakdown? When does passing in the wrong value cause problems in mySQL? Let's take a table EmailLookup forexample. Show More Summary
The Effect of using Cloudfront and why it matters
For years (12+) I have been building systems on every tier of the web. Everything from low-level OS optimizations, mySQL internals, interpreted language performance tricks to static content optimization. Building CDN's are easy, butShow More Summary
Using live code interrupts to produce stats which intern improves code
How do you know that your code is fast? Is it fast for your test cases or is it fast for every case? When changes are made how does that affect your customers? How do you know over a period of time if the system is faster or slower.The...Show More Summary
Handling the Hockey Stick Growth
The term hockey stick is used to describe the effect of an app that suddenly goes viral. Take a look at the graph to the left. There is modest growth and suddenly, the app goes viral and takes off. It looks like a hockey stick, ala the...Show More Summary
Facebook should launch FBCloud and compete directly with Amazon, Google and others
Another Facebook should do post by someone outside of Facebook; but its a money maker that Facebook has not tried andprobably has the best chance of succeeding at (not like deals hehe). Some ofthe best DEV Ops work at Facebook. Facebook knows scale. Show More Summary