I am Disappointed in Frontier Communications

| Comments

Is this title too strongly worded?

I’ve been a FiOS customer for more than six years. Our account was originally owned by Verizon. They sold their Dallas-Fort Worth FiOS lines to Frontier about three years ago.

We started with 35/35 symmetric FiOS Internet service. I believe it was during the second year of service that we bumped it up to 75/75. Speed and reliability were fantastic. I only recall one long outage during those six years, and my speed tests almost always came out at least 5 megabits per second faster than the advertised speeds. Moving large files back and forth from my own colocated server were just as fast.

Then we moved to a house not far away. Google Maps says it is a 2.1 mile drive. We’ve had amazing service from Verizon and Frontier for the past six years. We knew we had to order Frontier’s FiOS before we moved in.

This is where the problems started.

I don’t enjoy writing posts like this

If you can’t say something nice, don’t say anything at all. If something is terrible, I probably won’t tell you about it.

If I find a video editor that’s much better that what I’ve been using, I’ll tell you about it. If I find some great, new shell plugin or terminal-based program, I will tell you all about it. I’ll tell you what I like about it, and I’ll tell you if it has any problems.

If I order something from Amazon, and it is a piece of junk, I will just throw it away. You’ll never hear about it. It isn’t worth mentioning.

I have escalated my issue with Frontier as far as I can. I don’t know where else to go.

Apr 20: Frontier doesn’t service this address

My wife called Frontier to order FiOS service. I may have the precise facts a little off here, since I wasn’t directly involved. This should be pretty close.

The first person she talked to said our address doesn’t exist. This seemed interesting to me. We bought this house from my friend Brian. He’s had FiOS since he moved in, and he was living in this house long before my wife and I moved back to town. I’ve seen the FiOS gear. I’ve used the service. This seemed weird.

She tried again later, and the next representative explained that their system was down, and they couldn’t check whether FiOS was available or not.

The next day, Frontier was able to schedule a technician to come out and install FiOS on May 2. However, they said it would be a completely new install. Frontier claimed that FiOS never existed at this address.

My chat logs seem to indicate that she started this process on April 20. I can’t verify what day she finally managed to order our service, but I would expect it to be April 21. May 2 was about a week and a half away. That was a disappointment, but other things had conspired against us anyway, so we pushed the movers back a week.

Mobile data

The few days between our move and the installation of FiOS were pretty rough on my mobile data. I don’t have a large data plan. Unless I’m traveling, it is rare that I use more than 500 MB. Even when I’m traveling, I only wind up using 2 or 3 GB per month.

My Data Usage

I realize this screenshot is a bit off. I’ve done a bad job, and I’ve used two different phones this month due to some photography drone experimentation. The screenshot says I’ve used 34.6 GB of mobile data. I really got closer to 40 GB in that billing period. I am thankful for large, accumulating data stashes.

I thought wouldn’t have to tether after Frontier installed our FiOS service. That was almost three weeks ago.

May 2: FiOS is installed

The technician was very excited. It sounded like he thought this was going to be a brand new installation. All he had to do was upgrade us to a new ONT, because we were upgrading to 150/150 symmetric Internet service.

I told him that my wife tried to explain this to customer service when she was placing the order, but they just wouldn’t believe her.

It took him a little while to replace the ONT. Once he was done, I ran a speed test, and I registered something like 160/30. The 160 was right in line with the 80/80 I used to get on my 75/75. The 30 was disappointing.

This is where I’m my memory gets a little fuzzy. I can’t remember why I let the tech leave so quickly. When I talked to my wife later, she informed me that when she ordered the service she was told that it might take up to 12 hours for everything to be configured on their end.

I was dubious, but I was seeing better than 150/150 later that night, so I didn’t worry about it.

May 3: The link goes down

I wasn’t saving a seemingly constant collection of speed test screenshots at this point, but this is when my uplink dropped into the toilet. I was involved in two different text chats with tech support that day. For some reason, only the first of the two chat logs was emailed to us.

The first chat started at 2:53 PM and lasted for about 25 minutes. They asked me to use Frontier’s speed test site, and I explained that I was seeing 155 megabits on the download test, and the upload test was erroring out after a short while.

At some point during out chat, my upload speed returned to 150 megabits, and our chat session drew rapidly to a close.

I do not have a good record of when the second chat began. My laptop was tethered to my phone, and I was in a text chat with tech support on that laptop for more than two hours.

Towards the end of our troubleshooting, I was asked to plug the Ethernet coming out of the ONT into a laptop. I used my wife’s Windows 10 laptop.

As with just about every time we reset the ONT, my speeds were alright at first. The tech decided my router must be bad, so they put in an order for a replacement. Just minutes after that my upload started dropping. One speed test, it was in the 70 megabit range. Then the 30 megabits. Then less than one megabit. Then the Ethernet light on the laptop went dim.

This was the common occurrence of the day. The Ethernet link was dropping out.

They decided my router wasn’t bad, but they couldn’t cancel the replacement order. They needed to send a tech out to replace the ONT. He was scheduled to come out on Sunday, May 5.

May 5: Replacing the ONT

The first thing the new tech noticed was that the original tech didn’t replace the ONT’s battery backup. He said the new ONT units need the new power supply, so that was the first thing he replaced.

It didn’t help the situation. Then he replaced the ONT, and the Ethernet link came back up. Upload speeds were still abysmal.

First we tried through the router. Then we plugged my laptop, a Core i7-7700HQ laptop running Linux, into the ONT. I was getting terrible upload speeds. I am not sure exactly what those speeds were, but the tech agreed that it wasn’t good.

He suspected the problem would be a bad PON card out on the street somewhere. He needed to run a test with a “special laptop.” He was vague about that, but he said they’d be out tomorrow.

May 6: Nothing works except Frontier’s laptop

A third tech came out on Monday, and he brought the magic laptop. What’s the magic on this laptop? Absolutely nothing. He was just running speed tests from the same Frontier site as me.

We spent a lot of time testing things, but he explained that the only way we could get anyone to look at the PON card was to see a bad speed test on Frontier’s blessed laptop while plugged into the ONT.

I’m never going to recall the exact order in which he tested things, but we tried a lot of configurations.

My laptop plugged directly into the ONT couldn’t do better than 30 megabits per second on the upload test. His laptop plugged into the Frontier router had just about as much trouble as I did with my speed tests.

It felt like we were making progress. He plugged the blessed laptop directly into the ONT, and everything was fine. We couldn’t reproduce the problem. He figured I had a bad router, and suggested I buy my own. He claimed the Frontier supplied routers—that I didn’t know were rented for $10 per month—are horrible.

I asked if he had another one of these routers in his truck, and he did. So we hooked it up. Guess what? He couldn’t get a good speed test on his blessed laptop through the second router.

At this point, my wife’s laptop, my laptop, the first Frontier router, and the second Frontier router were having trouble with the uplink when plugged into the ONT. Frontier’s magic laptop is the only one that worked, and it worked every time.

We were at the end of his road. There’s nothing more he could do. I told him I was going to go grab a spare router that was still connected to my network at our old place, but when that doesn’t fix the problem, where do I go next?

I couldn’t get an answer useful answer.

So after he left, I took a short drive to pick up my old D-Link DIR-860L. I was using it as a Wi-Fi access point, and I chose that router, because it is well supported by OpenWRT. I never did put OpenWRT on it, though!

My old $30 router worked fine for a few hours. Aren’t intermittent problems fun? When my uplink speeds fell under 1 megabit again, I turned to Twitter.

May 8: Contacted by an Account Manager on Frontier’s Social Media Team

The account manager seems like a great guy. I would never mention anyone by name in this post, but I’d say the same thing about everyone else I’ve dealt with. They all seem like good people, and they all seem like they want to help.

I don’t believe this is the fault of any of the lovely individuals I have interacted with. They just don’t seem to have the power to get my problem resolved.

May 9: I did lots of local troubleshooting, and spoke to my Account Manager on the phone

If I’m remembering this correctly, I had a weird pair of speed test runs. This has become my habit—running speed tests. I ran a test, and my desktop’s upload speed was well under 1 megabit. I almost immediately ran another test on my laptop over 802.11ac, and it was reasonably fast. I repeated the test on the desktop, and it was bad again.

Uh oh. Did I screw something up? I purposely tested the wiring from my home office to the wiring cupboard over the weekend. Everything should be working!

There’s a 5-port Gigabit switch in my office. There are a pair of 5-port Gigabit switches in my wiring cupboard. The router in the wiring cupboard has 4 Gigabit switch ports.

Every room in the house is wired with Cat-5e. I helped run all this cable in 2011!

I’m a fan of iperf. It is a client-server program used to test the raw throughput of your network. Copying files around is a great test, but it can be limited by disk speed or your file sharing protocol.

I have an Infiniband network in my office. I can’t saturate the link unless I run at least three or four parallel transfers of very large files at the same time. Iperf has no problem maxing things out. I can’t hit the 20 gigabit maximum speeds of my Infiniband ports, but I am right near the theoretical limits of my 4x PCIe 1.0 Infiniband cards—7.6 gigabit out of a maximum of around 8 gigabits per second.

I ran around the entire house with my laptop. I ran iperf tests on ports in almost every room. Every test allowed me to push 950 megabits per second in either direction between my laptop and desktop.

iperf gigabit test

For the final test, I plugged [my laptop][lt] directly into my D-Link router. The traffic to or from my desktop has to traverse the switch on that router if I’m talking to the Internet. My laptop could run perfect 950 megabit per second iperf tests without any issue.

I sent an email to my account manager explaining all of this, and making sure I reiterated everything we’ve tested so far. Three routers and two laptops have never seen reliable upload speeds. Only one laptop has appeared to work correctly—Frontier’s own laptop.

He emailed me back later that day to tell me that my upcoming technician visit on Friday was canceled. They believe the issue is the PON card, and someone will be working on that.

May 10: A second replacement router arrives

I don’t know which day the first replacement router arrived. I just put it off to the side. I figured I’d worry about sending it back when my issue gets resolved.

This tweet isn’t relevant, but I enjoyed it immensely.

On May 10, an extra replacement router showed up at our door.

May 12: I start posting daily updates on Twitter

If I’ve been counting, this was my 11th day since the installation of FiOS without a reliable Internet connection. I wish I had intermittent outages. Instead, I have intermittent bursts when things work somewhat well.

This is when other people begin taunting me with their FiOS and Google Fiber speed tests. I don’t want their 500 and 1000 megabit speeds. I just want reliable upload. Is that too much to ask?

May 13: I had to request an update

My account manager told me there was no change, but this time he said they were going to “add a gigabit splitter at the distribution hub.”

My job title hasn’t been Network Engineer in almost 15 years, but this didn’t make sense to me. This is a change. It sounds like a completely different issue than I was diagnosed with early.

I’m only getting a peek into the inner workings of Frontier’s FiOS network. It is like a black box from where I’m sitting. I can only troubleshoot so deeply, and I have to take their word for things.

May 17: Maybe it will be fixed in another week?

I’ve been avoiding copying direct quotes into this post. It just doesn’t feel right. I just don’t think I can summarize this email from my account manager.

I’m sorry to hear that. I’m thinking they should have this resolved fairly soon. If you’re not getting better performance by next Tuesday evening/Wednesday morning, I’ll run another ticket in for a status.

Wednesday morning will be May 23. That will be three weeks without a functioning Internet connection. Three weeks. I feel like I need to say that one more time. Three weeks.

May 19: Packing up Frontier’s hardware

It is the weekend, and I have some free time, so I started opening boxes from Frontier. I needed to get the return labels out of the boxes just so I could stick them right back on.

I also had a return box for the original router.

Remember that extra replacement router that arrived on May 10? It wasn’t a router. It was a set top box of some sort. We don’t have TV service.

There were no instructions for scheduling a pickup from UPS, so I asked about that on Twitter. Apparently, that isn’t a service they provide.

Frontier is happy to charge $10 per month for hardware that their tech’s claim isn’t worth using. They’re happy to send a replacement that I didn’t even need. They’re happy to send me a set top box that I can’t even use.

However, they want me to pay for the pickup or spend 20 or more minutes of my time making a round trip to the nearest UPS store. This is after all the time I’ve put into trying my very best to get a working Internet connection.

They said they forwarded my shipping complaint to my account manager. I’ll be genuinely surprised if he doesn’t make it right, but that’s beside the point. This shouldn’t be happening at all.

May 20: I’m about to publish this blog

I decided to run Frontier’s speed test again. My upload speed was a miraculous looking 156 megabits per second. Fantastic!

I immediately ran it again. This time it was in the mid-70s. I ran it a third time and got 10.5 megabits per second. The fourth test finished at 1.9 megabits per second.

It is too bad that it is a rainy Sunday afternoon. I’d rather be flying racing quads than working on this blog post.

May 22: FiOS still isn’t working

I am going to have to tether to my phone today to upload a five-minute video to YouTube. Usually if I leave the upload window sit around for an hour, I’ll eventually hit a spurt of working upload. Not today. You’d think I’d be able to stop wasting my mobile data like this after three weeks.

My account manager is going to send someone out to pick up the two routers and the set top box.

May 24: Lowering my maximum speed

My account manager suggested that we try dropping me down to 75/75 instead of 150/150. My friend Brian had 35/35 or 75/75 in this house a month ago, and it was working fine every time I used it.

The hope was that if the some piece of hardware can’t handle 150, it may at least handle 75. At first, it wasn’t going well. I was seeing 90/1 or less. A few minutes later, and I was getting some 90/50 and 90/80 or so runs on the speed test.

Then I got 0.3 megabits upload on a speed test. I kept testing while I was talking to my account manager, and it started doing well again. He was about to be leaving for an extended weekend, and he was going to set me back to 150/150 if it wasn’t working. I asked him to leave it at 75/75. It couldn’t be worse, but maybe it would be slightly better. Who knows!

I imagine the problem is that Brian was plugged into 100 megabit hardware on Frontier’s end, and they moved the fiber to a gigabit port (GPON) when I started my 150/150 service. I figure I’m hosed unless they either fix the unhappy hardware or move me back to a 100 megabit port (BPON).

May 25: Maybe better. Maybe the same.

I’ve spent a lot of time away from my desk today. I’ve gotten in the habit of immediately running a speed test when I sit down and posting it to Twitter. I forgot to do that today!

When I went to check, things were going quite well. Lots of 93/89 speed test runs. The worst I had before that was 90/10. Is my connection finally starting to work?

Nope. I just had a 91.3/0.5 megabit speed test. The first time I tried to tweet a screenshot, it timed out.

May 29: A tech is scheduled for tomorrow

We’ve officially hit the four week mark. My account manager called today to inform me that a tech will be coming out to move me to a different “gigabit splitter.” I assume this is some sort of passive optical device, but I didn’t ask for clarification.

My account manager seems like a really nice guy, and I think he’s doing everything in his power to help me. I have no reason to doubt that.

This is why I was afraid to ask a few questions. Why didn’t we do this three weeks ago? Is this the new gigabit splitter that was mentioned a few weeks ago? Even if we couldn’t move me to a new gigabit port or device, why didn’t they move me back to an older, slower BPON port?

At any rate, I hope this is all resolved tomorrow.

May 30: I didn’t mention the EIGHT HOUR window

That’s right. My account manager said the tech was scheduled today between 9:00 AM and 5:00 PM. Eight hours. I asked if they’d call, and he told me they would.

I was woken up by an automated call to remind me that I had a tech scheduled today. It told me in English, and then again in Spanish, and started telling me which buttons to hit if I wanted to cancel the tech visit. I didn’t want to cancel the tech visit, but I had to stay on the line just to make sure I didn’t also have to confirm that I still wanted the visit.

There was just something about the robot lady’s tone that had me worried that I would have press a button to confirm that I did indeed still want a tech to come out. Having her repeat everything in a second language made the call take twice as long. I didn’t need this call at all. I was up late last night. I could have used more sleep.

I require functioning Internet access more than I require sleep.

The tech arrived around 12:30 PM or so. He messed around by the ONT, then asked me to unplug my router while he drove off to nearby remote CO—they don’t use the term remote central office for these boxes anymore, but I’m old, and I don’t know any better.

My FiOS connection is currently working great. He explained everything that he did, and I am going to do my best to repeat what he told me. My apologies if I’ve remembered any of this incorrectly!

He moved me from an older, congested Alcatel gigabit splitter to a newer Motorola splitter. He said I’m the second person on the Motorola splitter. I am assuming this is the gigabit splitter my account manager was talking about on May 13.

As I said, everything is working. I’ve been seeing better than 160/160 every time I run a speed test. Speedof.me even managed to reach 165/183!

I need to document this on my blog

Nobody reads my Twitter feed. I only have about 1,000 followers. Hardly anyone will see my daily FiOS connectivity updates, and in a few weeks, those tweets will be buried in the past.

People actually read my blog. Hundreds of people visit my blog every single day. Most of you arrive via search. I’m confident that when folks search for “Frontier Sucks” or similar phrases, they will see this page in their search results.

My struggle with Frontier will be here forever.

Time invested

Here’s a list of the time we’ve spent working with Frontier. It isn’t exhaustive, but it does have most of the major points.

  • Three phone calls just to get our installation scheduled (30 to 60 minutes?)
  • Showing the installer around so he could work (15 minutes)
  • Chatting with support and running around the house (2.5 hours)
  • Working with the second tech (at least 1 hour)
  • Working with the third tech (2 to 3 hours)

We have spent 6 to 8 hours of our time working with Frontier to get them to believe me that we have a problem, and getting them to actually work on that problem.

That’s an entire business day. Holy shit, right? I don’t even know what to say.

I don’t work a 9 to 5 job anymore. How many blog posts could I write in those six hours? How many times could I have taken my quads to the park for some flying? How many times could I have gone out to dinner or just hung out with friends?

I place a high value on free time, and I haven’t had as much as I’d like this month. We ordered new FiOS service, because we moved into a new house. You can imagine what that entails. Unpacking, setting up your utilities, unpacking, arranging furniture, unpacking, hooking up your washer and dryer, and unpacking. We’re still unpacking.

I’m not sure about everything I want to express in this section. I just thought it would be a good plan to tally up the big blocks of time my wife and I have wasted on this.

Why am I sticking with Frontier?

Frontier provides the best, most reliable Internet connection in my neighborhood. There is no worthwhile competition. In fact, my friends from out of town are always envious. They want symmetric service like I have. Google Fiber and other initiatives have made FiOS a bit less impressive, but it is still light years ahead of most of the United States.

My only other real option is a cable modem from Spectrum. We’ve been using Spectrum for years at my local makerspace. They have business class service, and it is is stupidly expensive—at least it was for the first two years. I believe they’re paying 200/20.

Spectrum has a 940 megabit plan for a very reasonable price, but I couldn’t find their advertised upload speed anywhere on their site. Some other Google search results suggested that it might be as low as 45 megabits per second. I need more upload speed.

If you’re at TheLab.ms’s weekly Video Game Night, and you join in for some online Rocket League, you’ll know just how bad Spectrum’s service is. The game will constantly drop connections. Your opponents on the Internet will be warping all over the place half the time.

When I take my laptop to TheLab.ms, I just tether to my phone. It is so much more reliable.

When FiOS works, it works great. Unfortunately for me, it has been like pulling teeth trying to get a working connection at my new home. It is frustrating and disappointing.


Everything is working now, and I am hopeful this trend will continue. It took 29 days to resolve my problem. That’s way too long. Ridiculously long.

My wife had to make three separate phone calls before she could convince Frontier that our address existed and that we were in their service area.

I had to work so hard just to get a working Ethernet connection from Frontier. There have to be errors or dropped frames showing up on an interface somewhere. I’m amazed that this isn’t something Frontier can immediately diagnose.

The technician that replaced our ONT spent at least two hours at my house. I had to spend that time just helping him convince his next level of support that I had a problem somewhere outside of my home.

From there, it only took three days for my account manager at Frontier and I to convince the right people that there was indeed something wrong.

To get from knowing definitively that there was a problem on Frontier’s end to getting the problem resolved took 20 days. Yes, 20 days.

As I said in the opening paragraphs of this blog post, I have been a happy FiOS costumer for at least six years. We’ve lived through a month of terrible customer service. It is inexcusable, but now that everything is working, I don’t expect to have any serious issues for at least another six years.

Was it worth the wait? I’m not sure. In hindsight, if I’d known this was going to take 29 days to install FiOS in my new home, I would have ordered Spectrum’s 940 megabit service. In the long run, I’ll be happier with symmetric FiOS service, but it has been an infuriating four weeks!

Have you experience similar problem with Frontier’s support? I’d enjoy hearing your stories in the comments below!

My Leader 120 Micro FPV Quad - Four Months Later

| Comments

I feels like I’ve been flying the Leader 120 for a long, long time. I checked the date on the first blog post I wrote about the Leader, and it was dated February 22. That didn’t seem right, so I checked my order history. I ordered my Leader 120 on December 20. I ordered one for my nephew on January 5—about the same day mine arrived.

I have two reasons for writing a follow-up post today.

My Leader 120 Micro FPV Quad

It looks like I’m about to reach my four month anniversary with this little guy. That’s a reasonable amount of time to let you know how durable the Leader 120 has been.

And last week, I thought I flew my last battery through my Leader 120. It wasn’t irreparably damaged, but it was showing enough minor problems that I thought it would be time to replace and upgrade some key components. Upgrade to a Tooth Fair frame that could fit a Runcam Micro Eagle. Upgrade to a Runcam Micro Eagle. Upgrade to a 200 mw VTX.

What was wrong with my Leader 120?

The battery that I thought was my final battery was epic. It was the best flight I’ve ever had on my Leader 120. I was power looping multiple trees at the same time, then immediately lining up a few gaps, and then lining up passes through The Lady Tree. It was awesome! I usually have to cut out the boring parts of these videos, but this was three continuous, interesting minutes of flight!

This is the smoothest I’ve ever gotten the Leader 120. I upgraded from the generic 2.8” props to Gemfan 2540 props. That alone made the Leader smoother and more responsive. I also upgraded to Butterflight, and I messed around with filters until I could disable as many filters as possible. I’ll go over those details later.

What have I broken? The 3D printed camera mount cracked on one side, the VTX often cuts out at full throttle when the battery is full, and I found three nylon screws with their heads popped off.

Be sure to keep an eye on your nylon screws. With these screws broken, the only thing holding my carbon side plates in place was the camera mount. That’s why my camera mount broke!

I should also mention that I bent one of the Leader 120’s arms back in February. Something went wrong at the top of a power loop, and I fell from the sky and landed on a sidewalk. I bent the arm back into place, and it has been flying just fine ever since!

What went wrong at the top of the power loop? I had my minimum motor speed set too low. It shipped with an 8% minimum, and that feels extremely high. If you fly inverted, it seems like the Leader 120 is accelerating towards the ground.

If the minimum throttle is too low, the motors won’t always spin back up in time. I thought I had a good minimum set, but it was too low. That’s why I fell out of the power loop. I currently have my minimum throttle set to 6.5%. It is a lot easier to do inverted moves with this setting, and I haven’t had any flips of death.

How did the repairs go?

I replaced the broken screws and glued the camera mount back together. That’s it. It was easy. It is holding together well, and I expect to get another four months out of the repairs!

The VTX is still acting up. You can see it in the first power loop in the video above. It seems like the VTX is rebooting when I go full throttle. It only happens when the battery is fresh. I don’t have an explanation for that, but I’m going to live with it for now.

What’s this talk about Butterflight?

I’ve been itching to try Butterflight, so I decided to try it on my Leader 120. That went well enough that I installed it on one of my 5” quads, and that went so well that I installed it on all my quads. My first day with Butterflight wasn’t fantastic, though.

I started my journey by bumping the PID loop up to 8k/8k. I was impressed that the F3 flight controller in the Leader 120 could manage that. I had to turn off the dynamic filter to free up enough CPU to do that. I thought this would be a good choice, but it wasn’t.

I tried tweaking all sorts of things from the Butterflight Lua script on my Taranis that first day, but I just couldn’t get rid of the oscillations. I tried more filtering. I tried less filtering. I tried all sorts of Q and R values. I just couldn’t make it fly as nice as my Betaflight 3.2.5 tune.

How can I run 8k/8k and the dynamic filter?

This was problematic on this tiny F3 flight controller. I turned on the dynamic filter, and my CPU utilization was through the roof. What could I disable to bring my CPU utilization down from the stratosphere?

The most obvious thing to disable was the accelerometer. That wasn’t enough. Then I thought about dropping from Dshot600 to Dshot300, but I didn’t like the idea of adding to my quad’s latency.

What about Multishot? It is faster than Dshot600, but should require less CPU. In fact, it requires a minuscule amount CPU power. Multishot is so friendly to the CPU that I could probably turn the accelerometer back on. I didn’t, but I could.

The only thing I’m giving up is turtle mode, but I have never successfully turtled the Leader 120. It is always embedded in the grass, and it just can’t get up.

If you switch from Dshot to Multishot, don’t forget to calibrate your ESCs!

Would you still buy the Leader 120?

Absolutely. It is a tremendous value. It is about $90 from Gearbest or $120 from Banggood. It is a great deal at either price.

I spend most of my time flying 5” or 5.5” miniquads, but I bet I fly the Leader 120 at least once a week. Sometimes I’ll just fly one battery. Other times I’ll burn through all six. It depends on my mood and it depends on what’s going on at the location.

If there are lots of random people around, I’m more likely to fly the micro quad. It is less noisy. It won’t scare anyone. It won’t do any serious damage to anyone.

I’d be surprised if I have run fewer than 100 batteries through my Leader 120.

2S or 3S?

I started flying my Leader 120 with 550 mAh Infinity 2S LiPos. I already had six of them for my KingKong 90GT. The Leader was fun to fly on 2S. It was pretty quick and nimble, but it didn’t really have enough thrust to pull off anything too acrobatic. It was very difficult to manage to pull up at the very last moment. I hit the ground a lot!

I ordered 550 mAh 3S Infinity LiPos, and you should, too. It is so much more fun on 3S. So far, we’ve clocked the Leader 120 at 67 miles per hour with the radar gun. I’m confident that I can break 70 with the Gemfan 2540 props.

I run my batteries down to 3.5 volts per cell, and I usually get five minutes out of a 3S pack. It has tons of power, and it is tons of fun.

My Butterflight settings

I have no idea if I’m doing this correctly. I most definitely have absolutely no idea how to correctly tune the Q and R values—I can say with absolute certainty that plenty of people could tune this better than I can! I just went out to the field, and I tweaked the Q and R values using the Butterflight Lua script until I liked the way my Leader 120 felt.

If my understanding is correct, my Q and R values make no sense with an 8k/8k PID loop, but I have trouble arguing with the results. Here are the relevant parts of my configuration.

set gyro_filter_r = 200
set acc_hardware = NONE
set baro_hardware = NONE
set pid_process_denom = 1
profile 0
set dterm_notch_hz = 0
set dterm_notch_cutoff = 0
set vbat_pid_gain = ON
set anti_gravity_threshold = 300
set anti_gravity_gain = 3500
set setpoint_relax_ratio = 50
set dterm_setpoint_weight = 75
set p_pitch = 33
set i_pitch = 36
set d_pitch = 34
set p_roll = 31
set i_roll = 36
set d_roll = 31
set p_yaw = 110
set tpa_rate = 35
set tpa_breakpoint = 1280

As I said, I am running Gemfan 2540 props. My Leader has always been a fun quad, but it has never been this smooth and responsive before!


The price of the Leader 120 seems to be increasing. Four months ago, paying $85 for a Leader 120 seemed like a good risk on an unknown micro quad. I don’t know that I would have bought one for $120 at the time.

Knowing what I know today, though, I believe the Leader 120 is still a good value at $120. It is quick, but not scary. It is reliable. It is a ton of fun to fly.

My Leader 120 FPV Micro Quad

The Leader 120 easily meets all of my minimum requirements for an FPV quad. The flight controller is fast enough for an 8k/8k PID loop, it has the Betaflight OSD, it supports telemetry and the Betaflight/Butterflight Lua script, and it can run Dshot600 or Multishot.

Do you have a Leader 120 or one of its competitors? What do you think of yours? Have you tried Butterflight? Let us know in the comments, or join us on our Discord server!

Eachine Q90C Flyingfrog - Your Gateway to FPV

| Comments

I ordered the Eachine Flyingfrog three months ago. It looked like an interesting package. For about $90, you get everything you need to get a taste of flying an FPV quadcopter. There’s a brushed-motor quad, a remote control, and a set of FPV goggles. You even get a battery and a simple USB charger.

I’ve been carrying this box around in my car for weeks, but I keep forgetting to give it a try. I recently added a Ryze Tello photography drone to my oversized backpack. These two drones are trying to meet different needs, but there will be some overlap for some people. Even though they are meant to serve different purposes, there are two obvious similarities. They both use 8520 brushed motors, and they are both priced at around $100.

You won’t be doing any photography with the Flyingfrog. A lot of people seem to think they’ll have fun flying their Tello in FPV using their phone. If you’re more interested in flying FPV than taking pictures, you’ll have a lot more fun with the Flyingfrog.

It will be a while before I collect enough photos and video to decide if the Tello is worth the price, so I figured I should write about the Q90C Flyingfrog first!

You get what you pay for

I’m going to get this part out of the way. The experience isn’t great. The goggles work, but the screen is tiny and difficult for me to focus on. The remote control works, but they have a huge dead zone near the center of the sticks.

It isn’t like flying a proper FPV racing or freestyle quad. I’ve flown several micro quads with brushed motors just like the Q90C Flyingfrog, but I flew all of those other brushed quads with a $200 radio. There are no dead zones on Taranis or Spektrum radios. As an experienced FPV pilot, the dead zones on the Flyingfrog’s remote control are infuriating.

You still get a lot for your money

I started flying FPV quadcopters more than a year ago. At the time, all the veterans told me how good I had it. I only had to pay $200 for a radio, $100 for a set of entry-level goggles, $250 for an overpowered bind-n-fly racing quad, $50 for a charger, and $25 per battery. It was so much cheaper than when they got into the hobby two years earlier.

That was still over $600 just to get in the air. Things have improved since last year. You can probably get in the air today with a BFight 210, a Taranis Q X7, and a $50 set of box goggles for well under $400. The BFight 210 is an excellent quad at an amazing price.

That’s still three or four times more money than the Eachine Flyingfrog, and that $400 only gets you entry-level gear. Do you want to spend $400 just to learn whether you’re interested in the hobby?

Even with its faults, I think the Flyingfrog is an excellent way to try FPV. Let’s talk about what’s in the box.

The goggles

Why am I talking about the goggles first? If you decide that flying FPV quadcopters is a fun hobby, the goggles are the only thing in the box that you will be able to use with your future quadcopters.

The goggles work surprisingly well. They’re the smallest set of box goggles I have ever used, but they also have the smallest screen. They have an internal battery that charges over USB. They are standard 5.8 Ghz analog FPV goggles.

I can definitely fly with these goggles. The reception is surprisingly good, and I have even flown one of my most expensive FPV quads with them. They work fine, but I switched back to my Fat Shark goggles as soon as I verified that the Eachine goggles work!

If you do get into the hobby, you’ll definitely want to upgrade the goggles. That said, though, you could most certainly limp along with these goggles for your first few months. You’ll also be glad you have a spare set. They will make an excellent set of spectator goggles.

The Q90C Flyingfrog quadcopter

The Flyingfrog is an overgrown Tiny Whoop. It is a bit large for flying indoors, but that didn’t stop me from trying. It has enough power to fly outdoors on a breezy day, and it can manage to do some simple acrobatics.

The Q90C has props guards, and I would highly recommend using them indoors. The trouble is, the prop guards are way too fragile for a quadcopter this heavy. I don’t even think mine has been in the air for 30 minutes yet, and I’ve already broken two.

It works a lot like our full-size miniquads. It can fly in angle, horizon, or manual modes. In angle mode, the quadcopter will level itself, and it will only tilt to a limited angle. Beginners usually prefer this mode—if you get in trouble, just let go of the left stick and the quad will flatten itself out.

If you want to do acrobatics, you’ll want to fly in the Flyingfrog’s manual mode. Manual mode is equivalent to Betaflight’s rate mode. That means you have to keep the throttle above zero during acrobatic moves—even when you’re upside down! Most pilots use Betaflight’s air mode so we can drop our throttle all the way and still have a responsive quadcopter.

This is difficult for me to get used to, and this is why I fell out of the sky in my video when trying to do a power loop!

The radio

We refer to it as a “radio” or “transmitter”. You might call it a remote control. It is the thing with the sticks that allows you to control your quadcopter.

The Q90C radio feels terrible. For the price, though, I find it difficult to complain. It has huge dead zones at the center position of each stick. When you’re trying to perform delicate maneuvers, you’ll push the stick slowly, then all of a sudden the quad will respond to your input more rapidly than you intend.

This makes it difficult to fly with precision, but the Flyingfrog isn’t exactly a precision machine. It is a toy meant to give you a taste of what it feels like to fly a real FPV racing quad. It does that job well enough. If you’ve never flown before, you’ll probably get used to it quickly.

Flying in the simulator

This is probably the best part about the Flyingfrog. You can use the included hardware to fly in most FPV simulators!

Setting it up is a bit convoluted. You have to plug the Flyingfrog quadcopter into your computer. Then you hit the CH/GAME button on the remote control. It should be detected as a USB joystick.

I tested it in the Liftoff simulator running on Linux. Everything worked just fine.

The simulators are awesome. For Christmas, we got my 13-year-old nephew a 5” BFight 210, a Taranis X9D+, and everything else he would need to fly FPV. We put him in the simulator for an hour or so two days in a row. We took him out to the park, and he flew around the big, open field.

That night, we let him practice flying through race gates in Liftoff. The next day, he was flying through our race gates with his real quad. It took me a month of real-world practice to do that without having a simulator.

If you can fly well in the simulator, you are probably ready to fly a real racing quad!

What is the upgrade path?

I firmly believe practicing in the simulator is the fastest and cheapest way to learn to fly. Being able to use the Eachine Flyingfrog’s controller in the simulator is a good first step, but you will quickly hit a wall. Even if you could manage to get used to the dead zones, the stick gimbals are quite awful anyway.

The first thing you should do is upgrade your radio. You’ll want to upgrade to something you can use with all your future quadcopters. You should definitely get a FrSky radio. I am a fan of the $190 Taranis X9D+, but the $110 Taranis Q X7 is also a fine radio. You can plug either of these radios into your USB port to use with the simulators. They are the radios of choice for most FPV racing and freestyle pilots.

Once you’re ready for a full-size miniquad, there are a lot of options. I’ve already written about two of them. You can build your own, or you can buy something that has already been assembled. The parts are comparable. It is a lot like the difference between buying a computer or building your own.

My friends and I are all fans of the BFight 210. I’ve written about it several times. At around $140, it is quite inexpensive, but you get a lot for your money. It flies great out of the box, and it is light for a 5” miniquad. My friends regularly get 9-minute flights out of theirs. Even if you are heavy on the throttle, it is tough to get less than 5 minutes out of a single battery.

Most experienced pilots build their own quads. You’re going to be spending time repairing them, so you may as well build exactly what you want. I wrote about my 5S quadcopter builds for 2018. Those two quads are fairly high-end, and extremely durable. You can build something like that for around $350. You can spend more. You can spend less. It just depends on what your goals are!

You could also stick with micro quads. Brushless micro quads are finally starting to feel and fly very much like a full-size miniquad. I carry a Leader 120 in my backpack. It is priced at about $90—same as the Flyingfrog kit, but it doesn’t come with goggles, transmitter, or receiver. It is a fantastic little quad. I’d pay quite a bit more than $90 for it, but it is awesome that I didn’t have to!

Other alternatives

I was talking to my friend Mike. He borrowed my Flyingfrog and Ryze Tello for a Boy Scout event. When he stopped by to pick up the gear, we chatted about other alternatives.

Maybe you don’t want to get straight into FPV. Most of us started our journey flying toy drones line of sight. Mike recommends the SYMA X5C-1 from Amazon. For less than $60, you get a relatively large quadcopter, a couple of batteries, a controller, and some spare props. That’s everything you need to get started and keep flying for a while!

The SYMA drone is too big to fly indoors. If you want a cheap, indoor toy, you should be looking at the Eachine E010. For around $13 shipped, you’ll have everything you need to get flying. The Eachine E010 is a clone of the Blade Inductrix. It doesn’t have enough power to fly outside unless it is a completely wind-free day, but it is fantastic for flying around in the house!

I’ve not flown the Eachine branded model, but I have flown toy drones that look identical. I imagine they come out of the same factory. They fly just fine, but you get what you pay for. That said, they’re cheap enough that you can buy one for everyone in the family!

If you don’t want to wait for the $13 quadcopter to arrive from China, the JJRC H36 Mini Drone at Amazon looks identical to the Eachine. It is currently $20 with Prime shipping.

Eachine also has a Flyingfrog-style combo package—the Eachine E013, but it includes a Tiny Whoop clone instead of a Flyingfrog. I haven’t tried it, but Stew at UAVFutures says it is pretty good. I assume it is comparable to my Flyingfrog. It is also $30 cheaper than the Flyingfrog!

I like the lower price, and if you want to fly indoors, the Eachine E013 is probably a better fit than the Flyingfrog. Unfortunately, it doesn’t look like the E013 can be used to control a simulator.


If you haven’t flown an FPV quadcopter, the Eachine Q90C Flyingfrog is an inexpensive way to test the waters. Before I got into FPV, I had a $230 Spektrum DX6 radio and a $60 Blade Nano QX. I had no camera and no goggles. The only advantage I had with that setup over the Flyingfrog was the high-quality radio.

The Spektrum radio was a huge advantage, but I would have happily given that up at the time for FPV—especially if I got to keep the other $200 in my pocket!

If you want to try FPV, it is hard to beat the Eachine Q90C. You can spend $90, and be flying around your back yard or a park in no time.

How did you get started in FPV? Do you agree that the Eachine Flyingfrog would be a good way for a newbie to test the waters? Do you have a better idea? Let us know what you think in the comments, or join us on our Discord server!

My Favorite Lens - The Tamron F/2.8 28-75mm

| Comments

It has been almost two years since I bought my first DSLR—a used Canon XSi. The first upgrade I bought was a Canon 50mm f/1.8 prime lens. Being able to use such a huge aperture on that ancient camera was a fantastic upgrade. It wasn’t much later that I discovered the Yongnuo 35mm f/2 lens. It was just as good as the Canon 50mm, but it was a much more appropriate lens for me to carry with me.

It was the correct lens more often, but there were still plenty of situations where I needed a longer lens. I did some research, and I found the Tamron F/2.8 28-75mm. It covers more than the range of my prime lenses in both directions, the aperture opens nearly as wide, and a used Tamron 28-75mm doesn’t cost much more than my two prime lenses. Were the prime lenses a mistake?

NOTE: I haven’t searched through thousands of photos to find the very best in my collection. These are just photos that I like, and that I enjoy. Most of them were used in other blog posts!

Yes, the prime lenses were a mistake. Sort of.

I like having the prime lenses in my bag, but I rarely use them now. I can’t even tell you when I last had one on my camera. I do sometimes miss the size and the weight savings, but the [Tamron 28-75mm][f28] is much more versatile, and F/2.8 is close enough to F/1.8 most of the time. In fact, F/2.8 is often way too wide open on my current camera—a full-frame Canon 6D.

I learned a lot shooting with the primes, but I’d recommend that you skip the prime lenses and jump straight into the Tamron F/2.8 zoom lens.

Brian Moses at Beer Brewing Night

I already wrote quite a bit about my two primes. If you still want a prime, here’s the short version of my advice. Buy the Yongnuo 35mm f/2.0 for a crop-frame camera or the Yongnuo 50mm f/1.8 for a full-frame camera—in those conditions, they have roughly the same effective zoom.

But this Tamron lens doesn’t have image stabilization!

I know. There are comparable lenses that have stabilization, but they cost quite a bit more. The rule of thumb is that you can take a stable shot if your shutter speed is the inverse of your focal length. That means you should be capable of taking a steady shot at 75mm with a shutter speed of 1/75.

This only starts to get problematic in dim lighting. It was rare that I longed for image stabilization with this lens on my old Canon Rebel XSi, and the lighting would need to be extremely dim to prevent me from getting a shot with my Canon 6D.

BFight 210 Racing Quad

I took this into consideration when I was buying this lens. I knew image stabilization would buy my two or three stops. I also knew that a camera upgrade would get me at least two or three stops worth of usable ISO. I figured the extra $500 would be more valuable to me on my next body.

This worked very well for me. Your situation my be different, so your mileage may vary!

The Tamron F/2.8 28-75mm on a crop-sensor camera

The Tamron F/2.8 is a full-frame lens. You can use full-frame glass on a crop-sensor camera, but that doesn’t always work in the other direction. I tried to future proof as much as I could, so I was only shopping for lenses I could use on my eventual full-frame camera.

When I was shooting with my crop-sensor Canon Rebel XSi, I felt like the Tamron zoom lens was all I’d ever need. Crop-frame cameras enlarge your photos by about 60%. Their smaller sensor can’t see all the light coming in—they effectively ignore some of the light that would hit a 35mm sensor.

That extra zoom makes 75mm feel like 120mm. That’s not exactly telephoto territory, but it sure brings things in much closer than the naked eye. You can easily shoot on the other side of the street.

The Tamron F/2.8 28-75mm on a full-frame camera

The Tamron 28-7mm zoom is still my favorite lens. In fact, it spends most of its time mounted on my Canon 6D. It is a fantastic lens for shooting indoors. I can use it for taking close-up shots of small, inanimate objects, and it is a reasonable portrait lens when zoomed to 75mm.

My only complaint since upgrading to a full-frame camera is that I had to buy a lens to supplement my Tamron zoom lens. Full zoom on the 28-75mm with the Canon 6D is an awful lot like shooting with a nifty-fifty on a crop sensor. That’s about as far as I need to zoom when I’m indoors, but I surely can’t get a good shot of something on the other side of the street!

Long Exposure Bus

It is actually quite rare that I shoot outside, but I decided to add a telephoto lens to my bag. I ended up buying an ancient, used Tamron f/4.0-5.6 70-300mm lens. I wasn’t careful, and I believe I ended up with a pre-DSLR lens for film cameras! It does a fine job on a sunny day, but it works best if you keep the aperture wider than f/8.

Would you still buy the Tamron f/2.8 28-75mm for a full-frame camera?

Yes. I believe I still would. The Canon f/4 24-105mm would be a great upgrade, but it also costs a lot more than the $250 I paid for my used Tamron. I could buy a lot of interesting toys with the money I saved.

Canon 6D vs. Sony a7s

That said, you may shoot differently than I do. If I spent most of my time shooting on the streets, I would find the extra 30mm to be invaluable. For my uses, 75mm is more than enough to shoot people that are less than 20 feet away, and I’d hate to give up the f/2.8 of my Tamron zoom lens!


I have been shooting with my Tamron f/2.8 28-75mm lens since May 2016, and I’ve been using it on my Canon 6D since September 2016. In that time, it has rarely been removed from my camera. My wife took her Canon 60D on a week long trip once, and I let her take the Tamron with her. I felt lost several times that week. I was probably only shooting here at my desk for the blog, and I was using my Yongnuo 35mm prime. It is a fantastic lens, but it felt weird having to use it!

If I lost this lens, I would buy another in a heartbeat. I would go straight to Amazon and order one with zero hesitation. It is versatile, sharp, and the price is unbelievable.

Do you own a Tamron f/2.8 28-75mm lens? Do you own one its competitors? Let us know what you think of it in the comments!

Failing to Extend the RAID 10 on My KVM Server

| Comments

When I built my homelab server in 2015, I built it with future upgrades in mind. Since it was acting as my home NAS, room for more hard drives was important, and I chose a case with plenty of 3.5” hard drive bays.

Netflix, Hulu, and other streaming services have greatly reduced my storage needs. Last year, I had nearly a terabyte of free space on my NAS. The fastest-growing part of my collection of important data was the raw photos from my Canon 6D. I seem to take about 80 GB each year, so I assumed my first hard drive upgrade would be at least three or four years away.

Then I started flying FPV quadcopters. Last year, I recorded 209 GB of FPV quadcopter video. Most of that was low-bitrate, standard-definition DVR video recorded on my goggles. Last month, I started capturing FPV footage with a GoPro HERO5 Session. Those video files are much bigger, and I’ve already collected 151 GB of video this year. I won’t be surprised if I end up with 100 GB of video each month!

I bought another 4 TB 7200 RPM disk for my KVM server. That will give me an additional 2 TB of storage.

How many disks are currently in your RAID 10?

There are two disks in my RAID 10. Linux’s software RAID allows RAID 10 arrays to have just two disks or even odd numbers of disks.

I could have created a RAID 1 with those two disks, but that complicates adding additional disks. You can add a third disk to a RAID 1, but it won’t increase your available space—it will increase your redundancy with a third copy of your data.

If you have a RAID 1, and you want to increase your available storage space, you will have to use another pair of disks to create a mirror. I didn’t want to have to buy my disks in pairs.

With my two-disk RAID 10, I can install a third disk and extend my array. Linux’s software RAID 10 implementation will make sure there are two copies of every block spread across all three disks—two copies of each block spread across as many disks as you have in the array!

What’s involved in adding another disk to a RAID 10?

It is pretty simple, but there are quite a few layers involved.

  • Partition the new disk
  • Add the new partition to the RAID 10
  • Extend the LVM Physical Volume (PV)
  • Extend the LVM Logical Volume (LV) where my qcow images reside
  • Grow the file system that resides on this LV

That will take care of the KVM host, but it won’t do anything to directly address my lack of storage in my NAS virtual machine. I will also need to grow the NAS virtual machines’s qcow image.

  • Resize the NAS qcow image
  • Grow the NAS’s EXT4 file system to match the larger qcow image

I hit a road-block

This was supposed to be a straightforward blog post. Adding a disk to a RAID 10 is simple. I’ve done it before. No problems. This time, though, I seem to have outsmarted myself. I managed to get to the “Add the new partition to the RAID 10” step when I encountered a problem.

root@kvm:~# mdadm --add /dev/md1 /dev/sde1 
mdadm: added /dev/sde1
root@kvm:~# mdadm --grow /dev/md1 --raid-devices=3
mdadm: Cannot reshape RAID10 in far-mode
root@kvm:~# mdadm --grow /dev/md1 --layout=n
mdadm: Cannot reshape RAID10 in far-mode

I intentionally created this array using far-copies for the increased read performance. I didn’t know that it would take away my ability to reshape the array!

What to do next?

This should be easy to remedy, because I am running LVM on top of my RAID 10. I just need to migrate the data off the existing array, recreate the array using near-copies, then migrate the data back. LVM will do all the heavy lifting for me without any downtime outside of the hardware swap.

I have enough free disk space to make that happen right now. My two-disk RAID 10 is the same size as my new, single 4-TB drive. I could add that 4-TB drive to the Volume Group (VG), remove the RAID 10 from the VG, and then recreate the RAID 10.

I’m not brave enough to do that. I don’t have a lot of trust in a single, brand-new hard disk. I’d feel much more confident using a mirrored pair of disks as my temporary storage.

I asked my friend Brian if he had any spare 4-TB drives around. He is the NAS guy, so he usually has spare parts sitting around. I figured it’d be easier to borrow a drive from Brian than order another disk. It won’t actually be easier, but it’ll save me a few bucks, and it’ll be an excuse to write another blog post. That’ll have to do.

RAID is not a backup!

I try to say this as often as I can. RAID helps you prevent downtime. RAID may increase your disk throughput. RAID is not a replacement for backups.

Your RAID will probably protect you from a disk failure. It may or may not protect you when two or more disks fail. In fact, you may very well lose another disk when the array is rebuilding.

Your RAID won’t protect you from ransomware. It won’t protect you from accidental file deletions. It won’t protect you if you save corrupt data over an important file.

I have good backups, so why am I worried about using a mirror as temporary storage for this data migration?

Pretty much everything in my home directory is synchronized almost instantly to the cloud. My blog posts, my shell scripts, and even my save games are synchronized to my Seafile server.

Until recently, the largest files I had to regularly back up were the raw photographs from my Canon 6D. That adds up to less than 100 GB every year. All those raw files are stored in the cloud, on my laptop, and on my NAS.

Now I fly FPV quadcopters a couple of times a week. Every time I go out now, I come home with around 20 GB of GoPro footage.

Is this footage worth backing up? Almost definitely not. Just browsing through yesterday’s video is a time-consuming process. The older these videos get, the less likely I am to use them. Once I’ve compiled a video and uploaded it to YouTube, I don’t think I’ll ever touch the original video files again.

I’m not syncing these videos to the cloud, but I’d prefer not to put them in jeopardy on purpose.

I’d also be bummed out if I had to restore all these virtual machines. A little extra work up-front may prevent a whole bunch of problems later on!


I’ll get back to this in a few days. Brian used this as an excuse to upgrade his personal NAS to 8-TB disks. His 8-TB drives will be here soon, and I’m sure he’ll start the process of upgrading shortly after they arrive.

In the mean-time, I’m going to zero out the new drive and see if it gives me any problems! Once the drive arrives, I’ll document the process of juggling Physical Volumes (PVs). Once that is done, I should be able to document the process I was hoping to run through in this blog post!

root@kvm:~# dd if=/dev/zero of=/dev/sde1 bs=1M status=progress
1333833760768 bytes (1.3 TB, 1.2 TiB) copied, 7171.01 s, 186 MB/s 

This is the part where I usually ask my audience a question, but I don’t have a good question this time. If you have questions about any of this, please leave a comment below or join our Discord server!

IP Over InfiniBand and KVM Virtual Machines

| Comments

Two years ago, I added InfiniBand cards to two machines on my home network, and it was a very inexpensive upgrade. My raw network throughput between these two machines has increased from 1 gigabit per second to around 6.5 gigabits per second, and the two cards and one cable cost less than $60.

I’m not seeing the full 20-gigabit speeds that these cards should be capable of maintaining, because I only have 4x PCIe slots available in these two computers, and the older, more inexpensive cards operate at PCIe 1.0 speeds. If I had 8x PCIe slots, the speeds of these cards should double, and more expensive InfiniBand cards support PCIe 2.0.

IPoIB InfiniBand iperf Bandwidth Test

I’m quite pleased with my results, though. My Samba sequential throughput tops out at around 320 megabytes per second. This is a limitation of my low-power server and Samba’s single-thread-per-client limitation—faster InfiniBand cards wouldn’t change that. I can usually double that throughput when running three or more file transfers at the same time.

Why am I writing this two years later?

I’m not. Most of this blog post has been sitting in a draft for two years. I’m just fact-checking and adding a few closing paragraphs today. I’ve done a bad job here.

I don’t just write these blogs for you. They’re also documentation for my future self. If my KVM machine with InfiniBand burns down in a fire, I know I could get a new machine up and running. I ran into minor issues when I got this all set up the first time, and if I don’t document this, I’ll most likely run into the same problems again!

Limitations of IP over InfiniBand

You can run IP over InfiniBand, but that isn’t what it was designed for. It works great, but it operates at layer 2—that means you can’t bridge over the InfiniBand interfaces. This isn’t a huge problem, but it does require more effort than when you’re using something like 10 Gigabit Ethernet.

I ended up creating two new private subnets for my InfiniBand network—one subnet for the physical hosts to use, and another subnet on a virtual bridge for the KVM virtual machines. The routing between those subnets should have been easy, but I had trouble getting good speeds.

To get great speeds out of IP over InfiniBand, you need to set the MTU of each interface to 65520, and you can’t miss any interfaces. I had trouble setting the MTU of the bridge device. You can’t set the bridge’s MTU when there are no interfaces connected to it, and I couldn’t set the MTU of the bridge to 65520 until I connected a virtual machine and set the virtual machine’s MTU to 65520. This is fun, right?

What about Ethernet over InfiniBand? (EoIB)

Ethernet over InfiniBand would solve all my problems, but it would create new difficulties.

When I set this up two years ago, all of the EoIB implementation was maintained outside. This wouldn’t have been convenient for my setup. There are only two InfiniBand devices on my network, and one of those is my desktop computer. I often run bleeding edge kernels with scheduler patches on my desktop. Would they be compatible with the current versions of the EoIB modules? Probably not.

Some quick searches on Google lead me to believe that this may no longer be the case, at least if you’re running RHEL or Centos.

Why not skip this nonsense and use 10gbe?

I convinced my friend Brian to go the 10-Gigabit Ethernet route. His pricing says he can do two cards and a cable for less than my InfiniBand setup, and he’s getting a solid 9.8 gigabits per second and Samba speeds just like mine. So if you’re only connecting two machines, 10gbe is probably a wise decision.

InfiniBand starts to become a much better value as you connect more machines. There are 8-port InfiniBand switches on eBay as low as $50. The options for 10gbe switches start at more than ten times that price!

Brian is doing well with three machines, but adding a fourth 10gbe device will be problematic for him. I’m still in search of a good excuse to add a third InfiniBand device to my network!

IPoIB between physical hosts

IP over InfiniBand was extremely easy to set up. You just have to make sure your InfiniBand network adapters are in “connected” mode—they default to the much slower “datagram” mode.

auto ib1
iface ib1 inet static
        pre-up modprobe ib_ipoib
        pre-up echo connected > /sys/class/net/ib1/mode
        mtu 65520 
        post-up route add -net netmask gw

Once I got into connected mode, my iperf test numbers went up to over 6 gigabits per second. That’s well short of InfiniBand’s 16-gigabit-per-second limit—InfiniBand encodes data using 10 bits per byte. This is just about as fast as I can go with my combination of a PCIe 1.0 InfiniBand card in my available 4x PCIe slot.

I guess I’m going to have to route!

It should be easy to set up a handful of IP subnets and route from my desktop to the KVM server, then from the KVM server to a virtual machine, right? It turned out to be much more difficult than I had anticipated. It took me an embarrassingly long time to pinpoint my problem, too. You’ll get to benefit from all the time I spent investigating this conundrum.

My Ethernet subnet is My two InfiniBand ports are on the subnet— is the KVM server and is my desktop computer. I created a lonely bridge device on the KVM server named ibbr0—InfiniBand Bridge Zero. This bridge isn’t connected to any physical Ethernet devices, and its subnet is

wonko@kvm:~$ ip route
default via dev eth0 dev ibbr0  proto kernel  scope link  src dev ib1  proto kernel  scope link  src dev eth0  proto kernel  scope link  src 

I added a second virtio network interface to my NAS virtual machine and connected it to ibbr0. At first, this seemed to work quite well, since I was able to ssh from my desktop to the NAS virtual machine via this route.

As soon as I ran iperf, though, I knew something was wrong. To say the speeds were slow would be an understatement. I was seeing speeds less than one megabit per second!

Don’t miss any MTU settings

I set the MTU of my new network device on the NAS virtual machine to 65520. This partially solved my problem. I was seeing 5 or 6 gigabits per second from the virtual machine to my desktop, but I still couldn’t even reach T1 speeds in the opposite direction.

To be honest, I was starting to pull my hair out at this point. Why was it slow in one direction? Every network interface I could think of had its MTU set to 65520. I even tried running socat on the KVM server to bypass the additional route, and that got me up to 1.5 gigabits per second. Why couldn’t I hit that when routing?

As it happens, I missed setting the MTU on an important interface. No matter how hard I tried, I just couldn’t set the MTU on ibbr0. You do need to set the MTU on the bridge device, but you can’t set the MTU on the empty bridge.

When my NAS virtual machine starts up, it creates a virtual Ethernet device named vnet0 and attaches it to ibbr0. Once I set the MTU on vnet0, it lets me set the MTU on ibbr0. From that point on, I can get InfiniBand speed traffic through to my NAS virtual machine!

I do lose some speed when talking to the virtual server—roughly one gigabit in each direction. This is over five times faster than my Gigabit Ethernet connection, so I’m still quite pleased with the results!

Configuring the network interfaces

Setting up the IP-Over-InfiniBand configuration is easy enough.

/etc/network/interfaces on the KVM host
auto ib1
iface ib1 inet static
        pre-up modprobe ib_ipoib
        pre-up echo connected > /sys/class/net/ib0/mode
        pre-up echo connected > /sys/class/net/ib1/mode
        mtu 65520

auto ibbr0
iface ibbr0 inet static
        bridge_ports none

Setting the MTU on the bridge device took a little more effort. I only have one virtual machine that benefits from InfiniBand speeds—my Network Attached Storage server. I need to set the MTU after my NAS virtual machine is booted. Thank goodness QEMU offers hooks for this sort of thing!

#! /bin/bash

## If KVM machine named 'nas' is started

if [[ "$1" = "nas" ]]; then
  case "$2" in
      for x in $(brctl show ibbr0 | grep vnet | awk -e '{ print $4 }');do 
        ip link set "$x" mtu 65520
      ip link set ibbr0 mtu 65520

The configuration inside the NAS virtual machine is much more straight-forward. Just bring up the interface, and add the route to the InfiniBand subnet.

/etc/network/interfaces on the NAS virtual machine
auto eth1
iface eth1 inet static
        mtu 65520
        post-up route add -net netmask gw

And finally, here’s the InfiniBand configuration on my desktop.

/etc/network/interfaces on my desktop
auto ib1
iface ib1 inet static
        pre-up modprobe ib_ipoib
        pre-up echo connected > /sys/class/net/ib0/mode
        pre-up echo connected > /sys/class/net/ib1/mode
        mtu 65520
        post-up route add -net netmask gw


Setting this up wasn’t difficult. The MTU issue wasn’t easy to spot. Now that I’m aware of it, though, it is simple enough to circumvent.

My InfiniBand setup has been running for more than two years now without any issues. At first, it was running on my power-sipping AMD 5350 KVM host. I’ve since transplanted the hardware to my new Ryzen 1600 KVM box. I didn’t have to reconfigure anything. I just moved the hard drives and InfiniBand card to the new machine, booted it up, and everything just worked.

InfiniBand CX4 Cable

I store the raw files from my Canon 6D and the quadcopter videos from my GoPro Session on my NAS virtual machine, and I interact with all those files over InfiniBand. For the most part, it is comparable to working with the files on the local machine. If I had to start from scratch, I would still choose InfiniBand.

Are you using InfiniBand or 10-Gigabit Ethernet at home? I’d enjoy hearing about your experiences! Feel free to leave a comment or join us on our Discord server!

Ditching My 4S LiPos for 5S

| Comments

I recently started flying my quads on 5S LiPo batteries, and it has been an awesome upgrade. Until recently, I didn’t have enough 5S packs to spend an entire afternoon flying. I only had five 5S batteries, so I’d always end up flying a few 4S packs every time I went to the park.

That changed when I acquired a big, heavy 10,000 mAh 6S battery for field charging. I’m no longer limited to five 5S batteries. Now I’m carrying enough capacity to charge a dozen of my 1300 mAh 5S packs, and I can parallel charge six of those packs in about 23 minutes.

Last night, I pulled all the 4S packs out of my giant quadcopter backpack, and I ordered a few more 1300 mAh 5S batteries from chinahobbyline.com.

I don’t have enough data for science

Proper science requires rigor. Science requires consistent, repeatable tests. That is something I don’t have, but I have flown enough packs that I’m starting to feel confident in my earlier assessments.

When I fly a 1500 mAh 4S with a GoPro Session mounted to my quad, I lose quite a bit of flight time. Without the GoPro, I can often approach five minutes of flight time. Strap a GoPro to the roof, and I am lucky if I can hit three minutes. The extra weight of the GoPro is tolerable, but you can sure tell that it is there.

When I fly a 1300 mAh 5S, it doesn’t matter whether I have the GoPro or not. Most of my flights tend to last four to five minutes. I’m sure the weight of the GoPro is having an impact on my flight times. It can’t be by much, because I have plenty of flights at both ends of the range with and without the GoPro.

This is where my science is lacking. None of my flights are the same, and I fly with the GoPro more often than without—I only fly without the GoPro Session if I forget to bring it to the park.

Why 5S? Why not 6S?

Cost is my primary reason for choosing 5S. I can buy a 1300 mAh 5S LiPo for $25, and it will have more punch than the most expensive 4S pack. When I hammer the throttle, my cheap 5S pack sags to 3.2 volts per cell. That’s still 15.2 volts. You’ll have trouble finding a 4S LiPo that can keep the volts that high at full throttle!

I was also hedging my bets on my current quadcopter builds. I’m running 2600 KV motors—T-Motor F40 Pro V2 motors on one quad, and ZMX FinX30 motors on the other. These are great motors for 4S. If 5S wound up being too much juice, I could just continue flying on 4S.

I tried one of Brian’s 1400 mAh Tattu 6S batteries. The first minute of my flight was great. I was gently cruising around and blipping the throttle. The quad didn’t spin out of control or burst into flames—that’s usually good news!

Then I did a short punch out. It was oscillating quite a bit, but I’m sure some tuning of the TPA breakpoint would fix that. After I hit the top of the punch out, I began steering the quad to keep it away from the parking lot. That’s when I lost video.

I don’t know exactly what happened. The GoPro footage looks like there was a failsafe. The VTX definitely lost power. When it hit the ground, the video feed came back. I didn’t see the Betaflight logo, so I don’t think the flight controller rebooted. The impact knocked my GoPro Session mount off, and it rolled about 30 feet from the quad, so I didn’t get to hear whether the ESCs rebooted or not.

If I had to go back, I might have chosen the 2400 KV version of the F40 Pro motors. They’d be more appropriate for attempting 6S, and they’d still fly fine on 4S!

How fast is 5S?

It depends how you define fast. When I talk about fast, I’m almost always talking about acceleration. I don’t want a Buggati Veyron that can hit 250 MPH. I want a car that can hit 60 MPH in an insanely short amount of time—I can do that over and over again on a trip to the grocery store!

I feel the same way about my quads. I run Racekraft 5051 props. They have tons of bottom-end power, but they sure peter out at the top end. I brought the speed gun and some aggressive Avan biblade props to the field last weekend. I figured they’d have more top end than my Racekraft 5051 props.

My ZMX FinX30 Quad

Unfortunately, I couldn’t get my quad to fly well on the biblades. It was shaking and vibrating like crazy. I probably need to turn some filtering back on, but I didn’t have a laptop with me at the time. We didn’t want to waste the opportunity for a speed run, so I flew the 5051 props as fast as I knew how.

I only did two passes. The first pass was most likely the fastest, but we didn’t manage to get a reading on the speed gun. It was perfect. Brian says I was only about 8 feet from the ground the whole time, and I ran straight past him. It was a fresh 5S pack, and I managed to get it to sag all the way to 3.02 volts. That’s the most sag I’ve ever seen, so I must have been pushing it hard. The quad was only armed for five seconds when I was already past Brian and the speed gun!

The second pass wasn’t as well executed. I was flying less directly at the gun, I was gaining too much altitude, and I crashed right after the run. It felt like a failsafe—Brian says I must have outrun the radio signal!

The speed gun reading on that pass was 95 MPH. In my opinion, that is a respectable number for these stupidly aggressive props. I’m sure we’ll be trying some less aggressive, more aerodynamic props. I don’t think I’ll have any trouble breaking 100 MPH.

What is this talk about field charging?

In our local quad group, we’ve talked about field charging quite a bit. More often than not, we come to the same conclusion. We’d rather invest in more packs for the quads and do all our charging at home.

Our opinions have been changing, though. Most of us have upgraded from four-button chargers to ISDT Q6 Pro chargers. The ISDT chargers are fantastic for charging in the field, because they are small and powerful. I’ve plugged it into the car at the park several times.

It has been handy when new pilots are participating, and they don’t have enough batteries to fly all day. I’ve let new pilots use my batteries in the past, and I’ve had more than one of them come back smashed. If I charge their batteries, I don’t have to put my own at risk!

Several of us are now flying different battery voltages. We carry tiny 3S packs for our micro quads, 4S packs for [our older 5” quads][bf], and 5S or 6S for our newest quads. How many of each battery should you carry? Having a generous assortment of batteries will add a lot of weight to your bag.

10,000 mAh 6S Field Charging LiPo Battery

Charging at the car is fine, but I’ve found that I can only push the charger to four or five amps with the cigarette lighter port in the bag. I know I can get more juice directly from the battery terminals, but that’s a much bigger hassle, and charging in the car only works if we’re flying near the car.

I wound up buying a big, honking 10,000 mAh 6S LiPo from Hobby King for $70. They have a lot of these big LiPos ranging from 10,000 mAh 3S to 20,000 mAh 6S. It seems like one size is always on sale.

This battery is big enough to charge a dozen of my 1300 mAh 5S packs, 16 or 17 1300 mAh 4S packs, or a seemingly infinite number of 3S micro quad batteries. These big field charging packs are only rated for 10C, but on a pack this big, that’s 100 amps. It has no trouble driving the ISDT charger at its maximum charging rate of 14 amps. We can parallel-charge six batteries in less than 25 minutes.

NOTE: I need to verify the math on the 1300 mAh 4S packs. It should be close.


I don’t want the worlds fastest racing quad. I don’t want to race at all. I want my quad to be powerful enough that I don’t notice the weight of a GoPro. I want my quad to have as much power available when it is time to land as it did when I plugged the battery in. My 5S quad with 2600 KV motors gives me all that.

I also don’t want to have to pay for premium batteries, because I damage them all the time. I can buy three China Hobby Line 5S LiPos for less than the price of two premium 4S LiPos.

If my experience so far is any indication, the future of miniquads is almost certainly 5S or 6S batteries. Are you running 5S or 6S? Tell us about your experience in the comments, or join our Discord server and tell us about it!

Outsourcing My Self-Hosted Cloud Storage

| Comments

Five years ago, I was on the hunt for a Dropbox replacement. I wanted something that was open source, and something that I could host myself. The solution needed to be scalable There are a lot of options with varying feature sets.

I wrote a few paragraphs about each project as I tested them. I got farther with some solutions than others. Some packages didn’t have client-side encryption, so they were immediately scratched off my list. Some slowed to a crawl when I tried to sync more than a few thousand files. I needed to sync at least 100,000 files, so they weren’t going to work.

Once my testing reached Seafile, I never looked back. Seafile lets you break your files up into groups called libraries. In 2013, each Seafile library could easily scale up to 20,000 files. That was just enough to manage the largest folders in my home directory, and their efficiency has improved greatly over the last five years.

Catastrophe strikes!

I’ve used a colocated server for all my hosting needs for nearly a decade. The machine I’ve been using for the last four or five years is a 16-core Xeon with 48 gigabytes of RAM and four 2 TB hard drives. It had virtual machines hosting several websites, some random game servers, a Zimbra email server, DNS servers, and my Seafile server.

Late last year, my aging server finally died. The most important services running on that machine are the web servers that host my blog and Brian’s blog. We were smart enough to start using a CDN a few years ago. Cloudflare had the majority of our pages in cache, so we weren’t going to experience a serious interruption there.

Without the web servers, we wouldn’t be able to publish new content, so we both wanted to get back up and running pretty quickly. I have an extra 1U server here in my home office. I needed to decide whether I should get that up, running, and ready to go. Would it be cheaper and easier to migrate to the cloud?

It is definitely easier and faster, but my initial math didn’t make it all that much cheaper. All the reputable email provides charge by the user, and my storage needs are fairly high. My quick math put me within $10 or $20 of what I was already paying for my colo. I already own the hardware, so I wasn’t worried about that cost. This is a topic for another blog post!

Where should I host Seafile?

For my web hosting, it was a toss-up between Linode and DigitalOcean. I went with DigitalOcean, because they had better pricing on additional storage. I would need at least 350 GB just for my Seafile server’s data—that includes my data and my wife’s data.

I quickly set up Nginx on a $12 DigitalOcean VPS, and it has been happily hosting our websites ever since. Once that was done, I started investigating managed Seafile services. There aren’t a lot to choose from, and most of them are a lot more expensive than Dropbox or Google Drive.

I found a host that was cheap enough to make me nervous. Prometeus.net offers managed Seafile hosting on servers in Romania starting at around $30 per year. That gets you 200 GB of storage. I had to go with the 400 GB plan for just under $50 per year.

Adding 400 GB of storage to my DigitalOcean VPS wouldn’t cost me $50 per month, but it wasn’t all that far off! Not having to maintain a Seafile server instance has value, too, so I figured Prometeus was worth a shot!

Is cheap Seafile hosting slow?

Prometeus’s Seafile hosting is definitely on the slow side. I’m used to the speeds I get when syncing to my colocated server in downtown Dallas. It was only a few hops away, and it had no trouble maxing out my 100 megabit FiOS link. I could easily upload a gigabyte of data every minute or two.

Syncing my 320 GB of data to Romania was glacially slow. It took almost a solid week to upload all my data. Once my data got up there, it wasn’t so bad. It has been a long time since I used Dropbox, but they never managed to max out my FiOS link, either!

My Seafile Libraries

Seafile has me covered in two valuable ways. It keeps the files on my desktop, laptop, and tablet in sync. Most importantly for me, that means my blog posts can be edited from anywhere. If I save this blog post right now and open my laptop, it will be right where I left off. Blog posts are tiny, so they still sync almost instantly. Raw photos from my DSLR are a bit slower to sync, but they still usually only take a few minutes.

I also rely on Seafile for my backups. Seafile’s synchronization gives me three local backups of the most current state of my data. The server provides me with 90 days of history.

I feel like that has me covered pretty well. If a hard drive fails, I have local backups. If a file gets damaged, overwritten, or deleted, I can get it back from the server. If the cheap server disappears, I still have three local copies of my data.

Relying on Seafile for backups has been amazing. I don’t miss the old days of daily or hourly backups. All my changes are backed up in 20 or 30 seconds. Not only are my changes backed up, but they’re synced to at least one other machine almost instantly. How can it get any better?

Can you trust these guys with your sensitive data?

When you create a Seafile library, you can choose to encrypt it. If you do encrypt your libraries, all encryption and decryption is done on your end. The server doesn’t have access to your encryption keys.

You should encrypt your libraries. If you do, the folks at Prometeus don’t have access to your data. Seafile is open source, so it is possible to verify that the keys aren’t transferred to the server. I’m using the Seafile client from the Ubuntu repositories, so I’m trusting that the folks at Canonical aren’t sneaking anything into the binary.

I’m not worried about Prometeus stealing my data. I don’t have anything all that sensitive anyway.

Does Seafile’s deduplication work with encryption?

The short answer is yes. The truth is slightly more complicated.

Seafile slices your file up into pieces before uploading them to the server. Each block is hashed, and if the server is already storing a block with the same hash, then the client doesn’t need to upload the block. This saves time, bandwidth, and space on the server.

When encryption isn’t enabled, I believe Seafile deduplicate between any library stored on the server. If you share the server with your friends and family, and you all have a copy of the same large video, only one of you will have to upload it and only one copy of the data will be stored on the server.

If you’re using encrypted libraries, then the Seafile server can only deduplicate within the confines of a single library. This is a limitation that I am happy to live with, because I encrypt most of my libraries.

Why not just use Dropbox?

I don’t trust Dropbox. They hold the keys to access your data. This is true of Dropbox and many of their competitors. Some of Dropbox’s competitors claim that they encrypt your data on the client, and they have no way to access your data on their end. Unfortunately, their client software is usually closed source, so you have no way to verify whether or not they are doing things correctly.

Seafile is open source. If I had any idea what I was doing, I could look at the code and make sure it isn’t doing anything scary. I don’t have any idea what I’m doing, but my hope is that someone else does. This isn’t a fool-proof plan, but I’d rather put my faith in the open-source community than a profit-driven company.

My friend Brian has been using CrashPlan, but they recently shut down their consumer-facing business. That leaves him searching for a comparable service. I’ve been using Seafile for quite a few years, and I expect to be using it well into the future.

If the business entities behind Seafile wind up changing direction, the software won’t have a definitive drop-dead date. I’ll expect to be able to continue on doing what I’m doing until the software gets old, rickety, and completely abandoned—I will be able to move along on my own schedule.

What if the Seafile hosting provider disappears?

That will be a bummer. I’ve already gotten more than $50 of value out of the service. In the worst case, I’ll just have to set up my own Seafile server again. I’m not worried about having to do that, but it would be much better if I don’t have to!


Prometeus’s Seafile hosting is an excellent value. The speeds are reasonable, and the storage is affordable. If you’re already running your own Seafile server, and you are looking to move to a hosted solution, I’d say go for it. Upgrading Seafile on your own server is easy. Running garbage collection is easy. Even so, I’m excited about not having to worry about doing either one again.

/2014/09/self-hosted-cloud-storage-comparison-2014-edition.html “Self-Hosted Cloud-Storage Comparison – 2014 Edition”

Baratza Preciso Grind Consistency Issue

| Comments

I have had an ongoing problem with my Baratza Preciso. I don’t know how long I’ve had this problem. I don’t want to say it has been getting worse over time, but the failing part finally gave way last week, so I actually know what’s been going on all this time.

What’s the problem? Sometimes I need to move the micro-adjustment dial down when I’m tuning in a shot of espresso. Usually it works fine. Every once in a while, my grind will get extremely coarse instead of finer!

A delicious latte

I’ve had to replace the burr holder before, so that’s always the first thing I check. It has three thin tabs on the sides. These tabs are meant to break if a rock or hard bean gets jammed in between the burrs—better to break a $4 part than destroy the burrs or motor!

Every time I would check, the burr holder would be fine. I would reassemble everything, and it would grind just fine. This would happen every month or so, and it didn’t make any sense to me.

I recently learned that I didn’t need to disassemble everything to correct the grind issue. I could just rotate the hopper all the way to the coarsest setting, and then rotate it back. Problem solved. That made even less sense!

Permanent failure

The problem showed up again last week, but it wouldn’t solve itself. I inspected the burr holder, and sure enough, two of the tabs were half broken. The last time I broke a burr holder, I ordered four or five replacements, so I had them on hand. I replaced the burr holder, and I still couldn’t get a fine grind out of the machine.

The other likely culprit is the adjustment ring. I followed Baratza’s troubleshooting instructions, but I wasn’t convinced that it was broken. They recommend pushing down on the edges of the adjustment ring. If one or more sides are loose, then you have a broken adjustment ring.

I’ve broken an adjustment ring before, and this didn’t feel the same. It might have been slightly looser on one side, but I’m not so sure.

The adjustment ring was the problem

The adjustment ring itself looked just fine. The ring that secures the adjustment ring to the motor housing was damaged. I can see exactly what was broken, but I can only guess at what was actually happening.

The adjustment ring has three tabs on the bottom. These tabs fit through slots in the lower ring. When you rotate the adjustment ring, those tabs are then locked under the lip of the lower ring. One of the three segments of that lower ring was damaged.

Damaged Baratza Preciso retaining ring

This is what I think was happening. Sometimes when I was setting the grind finer, there was enough extra force to pop one of the adjustment ring’s tabs out of the damaged slots. I’m guessing that when I rotate the hopper all the way to the highest setting, the adjustment ring would manage to fall back into its slot.

It just so happens that the lower retaining ring finally cracked enough that it just can’t grind anymore.

I believe that my grinder’s little brother, the Baratza Virtuoso, would be susceptible to this problem as well.


Baratza is awesome. I made an excellent choice when I bought the Baratza Preciso four years ago.

Baratza’s support is top-notch, and their troubleshooting and repair videos are amazing. Best of all, I can order a replacement for every single component inside my Baratza grinder. As far as I know, that’s true of all their grinders.

If I had to buy a new grinder today, it would be another grinder from Baratza.

My FPV Quad Builds for 2018

| Comments

Late last year, my favorite racing quad met its end. An inductor worked its way loose from my Shuriken X1’s flight controller. It could have been a minor repair, but the Shuriken X1 was a dead end for me. Its all-in-one mainboard could only be repaired or replaced with another identical unit.

I wanted to be able to try some modern hardware. I wanted an F4 flight controller with the Betaflight OSD. I wanted a VTX that could be controlled via that same OSD. I also wanted to build a setup that would let me try 5S and 6S batteries.

That didn’t have to happen all at once, though. I kept the Shuriken X1’s 2305 T-Motor F40ii motors, 30a BLHeli ESCs, and my Runcam Eagle 2 camera. I ordered a Holybro Kakute F4 AIO FC, Holybro AtlAtl VTX, and an OwlRC Dragon frame. All the new hardware could handle 6S batteries.

UPDATE: The OwlRC Dragon frame has just barely enough room for 5.5” props. I’ve been running DAL Cyclone T5544C props on my new Hyperlite Flowride, and they’re fantastic. They are at least as powerful as my beloved Racekraft 5051 props, but they’re more efficent and A LOT smoother.

I’ve had jittery at full throttle on this build for a while now, but I wasn’t willing to give up the performance of the Racekraft 5051 props. The less aggressive profile of the 5.5” props have improved my FPV video feed quite noticeably!

Video problems led to a whole new quad

I had extremely wonky video on my new build, and I just couldn’t clean it up. I added a 1000uf 25v capacitor. I swapped cameras. I swapped the camera back and forth between the 5-volt regulator and direct battery power.

Wonky VTX video:

Then I swapped out the ancient OneShot ESCs for a set of 35A Wraith32 ESCs. That didn’t help either, but at least I was ready for higher-voltage batteries. That’s when I ordered my first 5S battery!

The only thing left to replace was the motors. I wanted to upgrade to T-Motor F40 Pro V2 motors, but they weren’t available yet. I had to wait a while, but they were a fantastic upgrade over my old F40 motors. The stators are 20% taller, but the new motors don’t add any additional weight. The new motors generate 30% more power, and they seem to be more efficient!

VTX Video with new motors:

The new motors fixed my video problems. I still get a bit of noise at full throttle, but it isn’t a problem. At this point, though, I have a brand new quadcopter!

I had to build a second one

My new F40 Pro V2 quad is amazing. It has more power than I’ll ever need. I thought the same thing about my Shuriken X1. The new quad on 4S makes the X1 look tame. Strapping on a 5S battery turns things up to 11!

I had some minor problems with my build. Loose wires. Problematic VTX antenna placement. These things are easy to fix, but they take too much time and effort to repair in the field. Every time I had a minor problem, I’d have to switch over to my BFight 210.

T-Motor F40 Pro V2 Quad Waiting To Be Assembled

The BFight 210 is a fantastic little FPV racer. It flies smooth, and it is super efficient. Its light weigh makes it pretty quick, but compared to my new quad, it’s a snail.

I also keep hearing that the best way to improve is to fly the same quad every time. Every time I switch from the F40 quad to the BFight and back, I have to spend time adjusting.

Choosing motors for the second OwlRC Dragon quad

I was tempted to order another set of T-Motor F40 Pro motors, but that seemed so boring. They’re amazing motors, and they’re a known quantity, but I wanted to try something different. The new motors needed to be in the same class as the F40 Pro V2 motors.

I’ve had my eye on the ZMX FinX30 motors for quite a while. The FinX30 are 2207 2600KV motors, and they’re a couple grams lighter than my 2306 F40 Pro V2 motors. Miniquadtestbench.com says they generate a bit more thrust than the T-Motors.

The ZMX FinX30 are lighter, more powerful, and have a magical magnetic-field-manipulating bell. They’re also the same price as the T-Motor F40 Pro V2. How could I not give them a try?

The parts list for my 2018 quads

Here’s the parts lists. The total cost for each quadcopter was somewhere around $380.

  FinX30 Quad F40 Quad
Frame OwlRC Dragon DSX5
Motors ZMX FinX30
2207 2600 KV
T-Motor F40 Pro V2
2306 2600 KV
Props Racekraft 5051
ESCs 4x Wraith32 35A
FC Kakute F4 AIO v2 Kakute F4 AIO v1
VTX Holybro AtlAtl HV
Camera Runcam Eagle 2 Runcam Eagle 2 Pro
Antenna Generic cloverleaf TBS Triumph
Receiver FrSky R-XSR

Aside from the motors, the two builds are nearly identical.

UPDATE: Skip the Wraith32 ESCs. They fly great. They’re durable. I’ve been crashing them into stuff for three or four months now. I’ve only managed to knock an LED off of one so far.

I’ve built a third quad this year. I wanted to try a top-mounted battery, so I’m trying the Hyperlite Flowride frame. I’m using almost all the same parts as the builds in this blog, except I’m using a Holybro Tekko32 4-in-1 ESC and a Runcam Micro Eagle.

The Tekko32 is fantastic. It is reasonably priced, flies great, and seems to be almost completely noise free. I wouldn’t buy the Wraith32 ESCs again. I’d go with a Tekko32 4-in-1 or even four Tekko32 ESCs.

F40 Pro V2 2600KV vs ZMX FinX30 2600KV

I am not a professional pilot. I’m lucky if I can call myself an amateur. If I couldn’t see which quad I was flying, I doubt I could tell you which motors I was flying. They’re both powerful and responsive. They both handle 5S really well—they barely get warm!

According to the blackbox logs, both motors have no trouble hitting 9G of acceleration on the Z axis during a punch out.

At first, I was running them with Racekraft 5046 props. They’re my favorite prop on the BFight 210 and the Shuriken X1. Then I watched Bob Roogi’s video on the ZMX FinX30 motors. He suggested that big, powerful motors like these really open up when you use aggressive props. They’re powerful enough that the efficiency difference isn’t as big when running aggressive props.

I was skeptical. The Racekraft 5051 felt great on my Shuriken X1, but they drained my battery so fast. Could the 5051 work well with these more powerful motors?

They’re fantastic. Just like on the Shuriken X1, the 5051 props make these quads feel so much more powerful. They have so much low-end power. It is so easy to catch yourself when you’re falling fast. It is almost like the air feels thicker.

Do you know what the best part is? They’re not destroying my batteries. I can still cruise around at 40 to 50 MPH for six or seven minutes. When I’m heavy on the throttle, I don’t feel like I’m getting shorter flight times than on the Racekraft 5046, either.

The Racekraft 5051 are even better with a 5S battery!

What’s all this talk about 5S batteries?!

I already wrote a lot of words about 5S batteries, so I’ll keep it short here. Building a 6S-capable quad was an excellent decision. It didn’t add much to the cost, and flying 5S on 2600KV motors is so much fun.

We used to think the Shuriken X1 sounded angry and loud. These days, I’ll be cruising around the park and decide to do a punch out or scream across the field. I’ll hear people say, “What the hell was that?!” and someone will usually reply, “That sounds like Pat again!” If you enjoy showing off every once in a while, you should be running 5S.

Stack of 5S LiPo Batteries

I’ve been flying my 5S batteries with the throttle limited to 80% on the Taranis. Even with the throttle limit, the quads still have significantly more punch at the top end than they do on 4S. However, the throttle range is more comparable to 4S. When I fly a 4S, I flip the switch to move the throttle limit to 100%. That way, both batteries feel about the same when I’m trying to hit gates or gaps.

A $23 5S LiPo performs better than a $40 4S. Even when I’m at the tail end of a 5S pack, and I sag down to 3.2 volts per cell when I punch the throttle, that is still 16 volts. My worst sag on 5S generates more thrust than any fresh, fully charged 4S LiPo. I don’t think I’ll be going back to 4S.

I’m finally carrying a GoPro Session 5

I’ve tried carrying action cameras several times, and I’ve always been disappointed. My most powerful quad was the Shuriken X1. Strapping a camera on its roof made it feel heavy. It didn’t accelerate well, and the weight distribution made it corner like a truck. Yuck.

My new quads are a bit lighter and 30% more powerful than my X1, and the GoPro Session 5 makes the quads almost 20% heavier. Those numbers seemed promising—it’d still be an upgrade even with the additional weight of a GoPro!

My new quads have the same problem as my Shuriken X1. The battery is mounted on the bottom and the GoPro is on the top. With this setup, doing a flip or a roll is a bit like spinning a dumbell—all the weight is on the outside edges.

My worries were unnecessary. The OwlRC Dragon quads feel great with a GoPro on top. I almost want to tell you that I can’t even tell that there’s a Session 5 on the roof, but that would be a slight exaggeration. It flips and rolls with plenty of authority—enough that I wouldn’t be able to tell you whether there’s a camera on top. The quads definitely feel heavier when I’m heavy on the throttle, and flight time is shorter by about a minute.

That’s on 4S. When I fly 5S with the 80% throttle limit, it feels amazing. If I had to guess, I would say that the quads have more punch on 5S with the throttle limit and a GoPro than they do with 4S and no GoPro.

The flight controller and VTX

The Holybro Shuriken X1 served me well, and I’ve beaten the crap out of it. Several of my friends own one as well, and they’ve had pretty good luck, too. Our success has encouraged me to keep my eye on products from Holybro.

Holybro’s Kakute F4 and AtlAtl HV VTX are used in Holybro’s Kopis 1. The Kopis 1 is the successor to the Shuriken X1. I’ve been drooling over the Kopis 1 ever since its release. It is a well made quad built using premium parts. It may be the successor to the Shuriken X1, but it doesn’t perform like one. I think of the Kopis 1 as a premium BFight 210. The Kopis has efficent motors, but they’re not all that powerful.

I’ve essentially built myself a much more powerful Kopis 1. I’m pleased about this.

I’m using the AIO version of the Kakute F4. That just means it has an integrated PDB. My first build has the original version of the Kakute. Version 2 started shipping shortly after I built the first quad. I have no problems with the original Kakute. Holybro moved the pins around on the second revision.

I like that the Kakute F4 has a soft-mounted gryo. That means I don’t have to soft mount the entire flight controller, and this layout seemed to work well in my Holybro Shuriken 180 Pro.

I’m excited about the Holybro AtlAtl VTX. Your channel and output power can be controlled by Betaflight using the Tramp protocol. It supports pit mode along with power outputs of 25 mw, 100 mw, 200 mw, 400 mw, and 600 mw. I usually fly at 100 mw.

The Kakute F4 V2 is the flight controller Joshua Bardwell used to test the Betaflight Kalman filters. I’m hoping I’ll also be able to run 32kHz/16kHz on my Kakute F4 flight controllers as well!

Wraith32 35A BLHeli_32 ESCs

I didn’t go out of my way to find the best BLHeli_32 ESC. I wanted something fast, and a four-pack of Wraith32 ESCs was available with 2-day shipping at Amazon for about $58. That’s less than $15 per ESC, and the reviews of the Wraith32 are all favorable. They’re even listed on Joshua Bardwell’s ultimate FPV shopping list.

They’re also 6S-capable, so I was sold. I have nothing to complain about. The Wraith32 work just fine. They have current sensors and telemetry, but I’m not using it. Each ESC has a bright light on top.

If you want to use Betaflight’s turtle mode, be sure to upgrade to BLHeli_32 version 32.3 or higher. Earlier versions don’t support dshot commands!

The OwlRC Dragon DSX-5 frame

Choosing a frame is hard. I like both the HyperLite FLOSS and HyperLite Flowride frames. They’re inexpensive, well made, and extremely light. Those narrow arms aren’t ideal for individual ESCs, though. The Flowride wasn’t available when I built these quads.

I also like the X-Hover Stingy and the Armattan Chameleon and Armattan Rooster. They’re all nearly three times as heavy and cost three times as much as the HyperLite FLOSS. They’re really sturdy frames, but I don’t want to pay that much for all that extra weight.

OwlRC Dragon frame with ZMX FinX30 Motors

Joshua Bardwell easily convinced me to try the OwlRC Dragon frame. It is half the price of the Stingy or Rooster. At about 90 grams, the Dragon falls somewhere in between the FLOSS and the Chameleon’s weight.

The Dragon isn’t a heavyweight, but it is quite sturdy. It has replaceable 5-mm-thick arms. Once you get everything bolted together, the Dragon is extremely rigid. I’ve been crashing it into tons of trees and grass. I even obliterated a Runcam Micro Sparrow when I flattened a graphite race gate at full throttle.

I can’t say that I’ve hit any concrete with the Dragon frames yet. That’s what it took to finally break an arm on my Shuriken X1 after eight months of crashes. The Shuriken X1 had 4-mm-thick arms, but they were wider. In fact, the arms on the X1 and the Dragon have the same cross sectional area, so I’m quite confident in the Dragon!

My friend Brian Beverage built his second FPV quadcopter using the OwlRC Dragon frame and a lot of parts similar to my own. In fact, he had his up and running with F40 Pro V2 motors while I was still running the F40ii motors.

Runcam Eagle 2 vs Eagle 2 Pro

I am a fan of the Runcam Eagle line of CMOS cameras. A lot of people dislike the pixelated look of the Eagle cameras, and most people seem to prefer cameras with a native 4:3 aspect ratio. I am not one of those people.

I started my FPV journey with 16:9 box goggles. Those goggles encouraged me to buy 16:9 cameras. All those 16:9 cameras led me towards the 16:9 Fat Shark Dominator V3 goggles. Now that I have a good set of 16:9 goggles, I want all my cameras to match.

I’m not excited about the sharp, pixelated video of the Eagle line of cameras, but I’ve gotten used to it. I feel that the problem of sharp edges is far outweighed by the Eagle’s phenomenal wide dynamic range. When you fly directly at the sun with a Runcam Eagle 2, you can easily see detail on the ground, and the sun is just a small, white disc.

I’ve had my Runcam Eagle 2 since July. It has been by far my favorite camera. I bought a Runcam Eagle 2 Pro for my other Dragon quad in December. It is a better camera than the original Eagle 2, but not by a huge margin.

I wouldn’t buy either one today. The Runcam just released the Micro Eagle. I won’t be buying any more full-size cameras. I’ve tried the Micro Sparrow in the hopes that it would perform well enough, but the Sparrow is now Eagle. The Micro Eagle is the heaviest and most expensive micro camera.


I couldn’t be happier with my new builds for 2018. They’re extremely durable, stupidly powerful, and a ton of fun to fly. I still feel compelled to upgrade these and build even faster quads, but I’m doing my best to avoid that temptation. I want to fly these until I crash enough that they start giving me trouble!

When I broke my BFight 210’s frame, I replaced it with a 6” FLOSS frame. After flying the ZMX FinX30 motors, I’m extremely tempted to put a set of FinX23 motors on the old BFight. They’re cheaper and lighter than the FinX30 motors, but they can generate more thrust than my old T-Motor F40ii motors. They look like an amazing, inexpensive, and tempting upgrade for the BFight 210!

Are you flying a similar build? Are you using the FinX30 or F40 Pro V2 motors? Are you also experimenting with 5S batteries? Please leave a comment and tell us about your experiences!