The Breakthrough Propulsion Concept Sanity Checker

Propulsion is, on the surface, a very simple science: I make a machine which uses stored propellants or some medium my vehicle is interacting with to generate a momentum exchange with my surroundings, thus making my vehicle move in the opposite direction. But once you dive into the details of any propulsion system you will quickly find that mastering this 'simple' science requires a lot of detailed knowledge: thermodynamics, fluid dynamics, chemistry, heat transfer physics, statistical mechanics, material science, electronics and of course rigid body mechanics and dynamics are essential. If you work with space propulsion odds are you will also need to know quite a bit about quantum mechanics, electrodynamics, and plasma physics as well. Put synoptically, it's really hard to make a completely new propulsion system which will be a fundamental 'breakthrough' in the field. Many have tried; most have failed. But that of course doesn't stop a wide variety of scam artists as well as honest-to-goodness crackpots from standing up and claiming they have a viable 'breakthrough' propulsion concept. Sadly these people can often find support both among laymen (who have little resources to distinguish viable new concepts from obviously spurious claims) and even propulsion engineers who may be specialized in a different area.

I've been getting tired of these claims being reported in the media and discussed as if they had any merit. Not only does this spread false information among non-experts, but it also takes time and reporting space away from true progress in propulsion. Imagine for instance if the coverage of the garbage NASA reactionless drive coverage I posted about in August had instead been dedicated to the co-development of a full-flow staged combustion rocket engine by NASA and SpaceX. Not only is this more interesting than a reactionless drive because it actually exists, but it's also more useful as a technology and the story gives a better picture of how the aerospace industry actually works. Thus in the hopes of assisting not only prospective inventors of 'breakthrough' propulsion concepts but also laymen and elsewhere specialized engineers, I've compiled a list of guidelines for any would-be propulsion innovator. If there's something that's not on here which should be please let me know in the comments!

The List:

1. If your breakthrough propulsion concept relies on unobserved or falsified physics, it is exceedingly likely to be spurious. 

2. if your breakthrough propulsion concept achieves delta-V without expending reaction mass, it is exceedingly like to be spurious. 

3. Indeed, if your breakthrough propulsion concept violates the conservation of momentum or angular momentum in a closed system in any way, it is exceedingly likely to be spurious.

4. No propulsion system can ever, ever, EVER lead to a macroscopic violation of energy conservation. EVER.

5. building on that last point, if your breakthrough propulsion concept violates ANY of the laws of thermodynamics, it is purely fictitious.

6. No Unobtanium Principle: If your breakthrough propulsion concept requires propellants, power sources, or materials which either do not currently exist or have been shown to not be able to exist, it is fiction until those materials become available.

7. Math is your friend. If you cannot present and justify simple, first-order performance calculations for your breakthrough propulsion concept, the odds are it is flawed or impossible. 

8. Fallacious and unjustified reasoning is not an "approximation", it's just wrong.  

9. Almost any concept relying on the "quantum vacuum" is exceedingly likely to be spurious, most likely due to the proposer not understanding the physics of the QFT vacuum. 

10. Conference papers which have not been peer-reviewed are not evidence of concept validity. Neither are websites, blog posts, articles in low-impact/poor quality/obscure/for-profit journals, non peer-reviewed articles on online repositories or publications, self-published books, angry letters or emails to legitimate propulsion researchers, snarky comments on websites/blogs/online publications, or abstract macaroni portraits of your idea. 

11. Your tests of your prototype of your breakthrough propulsion concept are not evidence of validity until (1) they are written up, peer-reviewed, and accepted for publication in a well-known, mainstream aerospace or propulsion journal, (2) they are successfully duplicated by other mainstream propulsion researchers, and (3) these successful duplications are themselves written up, peer-reviewed, and published in a well-known, mainstream aerospace or propulsion journal.

12. Test results reported without a rigorous propagation of uncertainty, comprehensive analysis of systematics, and a significant number of data points, are meaningless and can (and should) be dismissed without review.

13. Similarly, test results obtained at a low level of statistical significance do not validate nor falsify a concept.

14. Preparing a press release or giving a talk on your idea before submitting it for peer-review is tantamount to being so arrogant you think you don't need any feedback from your colleagues. Since the most arrogant people in any subject are usually the least capable (see the Dunning-Kruger effect) this is a valid cause for skepticism in and of itself.

15. Patents are not the same as peer-review, nor are they evidence of validity. Just because you have the legal right to patent your idea doesn't mean anyone else has to take it seriously. In truth any idea which is patented before it is constructed, tested, and peer-reviewed is likely to be spurious.