• BullionStar
    05/30/2016 - 21:24
    The US Gold Market is best known as the home of gold futures trading on the COMEX in New York. The COMEX has a literal monopoly on gold futures trading volumes worldwide, but very little physical...

Dear SEC: Show Us The Data

Tyler Durden's picture


From Nanex

Compare The Time-stamps Already!

For the first time, the SEC's new multi-million dollar market data analysis tool, "Midas", allows the regulator to measure a stock exchange's compliance with a core rule that lies at the heart of regulations governing how our stock markets work. We are referring to rule 603(a)(2), which basically states that exchanges cannot send stock quotes faster to special groups than to the public quote (consolidated feed, more here). This is the same rule the NYSE broke and was fined $5 million for in September 2012. It was a data-feed delay analysis from Nanex, sent to the SEC on July 22, 2010, which tipped off the regulator and showed conclusively that a persistent delay existed in the NYSE public quote relative to the direct feed quote and this delay was not from the consolidation process.

Now that Midas gives the SEC the same ability Nanex had in 2010, we strongly urge them to use it to perform the same data-feed delay analysis on recent trading days (these 10 select days of 2013). This is an urgent matter as there is ample evidence that public quote delays continue to exist from several exchanges. These delays not only violate regulations, but they significantly disadvantage the 2.5 million subscribers who collectively pay almost $500 million annually for "real-time" public quotes.

Our method for detecting a data-feed delay is simple, straightforward, and will put Midas to good use. A good programmer with a few years experience should have no trouble coding the necessary logic in one or two days.    

Data-Feed Delay Analysis

In the first and only step, every quote and trade in the consolidated feed, over an entire trading day, is matched to its direct feed counterpart, with the results written to an ASCII text file where each line consists of data for one trade or quote with the following fields: the direct feed time stamp, the consolidated time-stamp, reporting exchange (which direct feed), symbol, price, and size. This output file should be made freely available to the public and universities for statistical analysis.

The regulator may also wish to perform their own statistical analysis to determine when, where, and to what extent the public quote is delayed relative to the direct feed quote. This analysis will determine the level of compliance with a key rule that lies at the heart of Regulation NMS. Its importance cannot be over-emphasized.

Recent speeches from the SEC indicate they plan to use Midas to look at the details behind quote stuffing, excessive order cancellations, the cause of mini flash crashes, and other nefarious activities. While these are all good uses for a market analysis tool (Midas), they pale in comparison to a data-feed delay analysis, because the former are governed by blanket, hard-to-prove manipulation laws, while the latter can be tied directly to a core rule that lies at the heart of Regulation NMS. An improper data-feed delay was the reason for the $5 million fine against an exchange in September 2012. Furthermore, millions of people are directly affected and disadvantaged by illegal data-feed delays. Therefore, it would be a great waste of public resources to not immediately pursue a data-feed delay analysis, because there exists ample evidence that an illegal speed advantage exists in direct feeds over the public quote.

Given all that we know about market data analysis and the state of the industry, we can think of only 2 reasons the SEC would avoid a data-feed delay analysis.

  1. Midas is not capable of performing this simple task. If this is the case, then it was a tremendous waste of public resources paying for this tool.
  2. The SEC wanted Midas not to detect fraud and abuse by certain participants, but rather to protect special interest groups and bamboozle the public into believing that markets are fair and transparent.

Although reason 2 is difficult for us to accept, we can think of no other explanation. Therefore, we look forward to seeing the results of the SEC's data-feed delay analysis and are ready to offer our years of experience should they need any assistance. If, however, such analysis does not occur in a timely manner, we will have to conclude that either Midas isn't up to the task, or the regulator is unfit to regulate.

To learn how we uncovered the delay in the NYSE public quote, continue reading.

Nanex Discovers the NYSE Public Quote Delay

More that 3 years ago, while analyzing the May 6, 2010 flash crash in detail, we discovered one of the prime causes for the crash, and a serious violation of a regulation that governs how stocks are traded in the United States (Reg. NMS). Specifically, we found that stock quotes from the NYSE were delayed by more than 30 seconds to the public quotation feed (chart 1), relative to Open Book, which is NYSE's expensive direct feed product used mostly by High Frequency Traders (HFT). A crucial sub-ruling in the regulations prohibits exchanges from giving stock quotes to special groups faster than to the public. This sub-rule is of such importance, that without it, the rest of the rules essentially become meaningless.

After we pointed out the severe delay in the NYSE public quote, the exchange immediately denied there was a problem: in spite of probing phone calls from major news media such as The Wall Street Journal (Tom Lauricella and Scott Patterson), The New York Times (Graham Bowley), Reuters (Herb Lash) , Bloomberg (Kambiz Foroohar), and Risk Magazine (Duncan Wood).

To satisfy a curiosity of whether the NYSE public quote delay was unique to May 6, 2010, we ran another quote-by-quote comparison of time-stamps from the public quote and Open Book for a 30 minute trading period in General Electric stock (GE) on July 21, 2010 (see chart 2). We chose this period because there was a noticeable lag in the public quote from the NYSE versus quotes from other exchanges, which rules out the consolidation process as a source of the delay.    

Once again, we detected sizeable delays between time-stamps in the public quote and Open Book. These delays ranged in the hundreds of milliseconds. Though the delay magnitude was far lower than the 10's of seconds discovered during the flash crash, it was still hundreds of times higher than expected.
Our first attempt at finding a cause for the delay involved comparing the trading activity in GE stock with the magnitude of the delay. Chart 2 shows the price of GE stock in red, along with the public quote delay in blue. The left price scale shows the delay in milliseconds (thousandths of a second). We couldn't find a correlation between the price and magnitude of the delay, and one does not present itself on the chart.

Next, we looked for a correlation between the number of quotes per second in GE stock and the delay, and again, found none.

We noticed that NYSE's quote was involved in crossed NBBOs (National Best Bid/Offer where bid price is greater than ask price, which is caused by a delayed quote from one exchange), in a large number of stocks. That led us to see if the number of quotes from the NYSE for all stocks in CQS (the public data-feed that transmits GE), was correlated with the delay

It was! More on that in a moment.

First, we had to rule out the possibility of the delay being caused by the consolidation process (which people often erroneously point out). To do this, we looked for examples of the NYSE quote lagging quotes from other exhanges in the public data-feed. This tells us that the delay had to exist before NYSE quotes were processed by the consolidated feed.

The chart on the right is one such example. It shows the quote spread and trades from 2 exchanges in GE. The NYSE quote spread is shown in light blue, and the Nasdaq quote spread in gray. When the two quote spreads overlap, the color is dark blue.

The red area is where the NBBO was crossed - a condition caused by the NYSE quote lagging far behind Nasdaq's, which resulted in NYSE's bid price remaining higher than Nasdaq's ask price. Note where the light gray shade shifts to 14.78 x 14.79 on the left side of the chart (14:13:13.650). The blue shade shifts to this same price almost 450 milliseconds later - which corresponds with the time-stamp difference between Open Book and the public quote.

Note the NYSE trades (blue circles) appearing before the NYSE quote - another indication of a quote delay from the NYSE and not the consolidation process. We coined this phenomenon fantaseconds and published many examples over the years.    

Now, back to the correlation we found which shows up nicely on the two charts below which detail one minute of time on July 21, 2010. The top chart shows the delay in milliseconds between time-stamps on GE quotes in the public data-feed and corresponding quotes in Open Book. The bottom chart shows the number of quotes per millisecond (over 10ms intervals) from the NYSE into CQS (the public data-feed that carries all NYSE, AMEX, and ARCA listed stocks. GE is listed on the NYSE).

Note that whenever the total number of quotes from the NYSE into the public data-feed exceeds about 20 per millisecond (red line on bottom chart), a delay appears in the top chart at the same time. That is, when the stack of blue crosses above the horizontal red line in the bottom chart, a corresponding stack of red appears in the top chart. The longer and further the blue crossed above, the higher the delay.

In other words, a high quote rate from any NYSE stock will cause a corresponding delay in all NYSE public quotes! Anyone with this knowledge can easily cause latency on demand.

Your rating: None

- advertisements -

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
Tue, 10/08/2013 - 12:18 | 4034111 yogibear
yogibear's picture

Quit bothering the SEC, their busy watching porn. The porn industry would be hit hard if the SEC was policed.

Tue, 10/08/2013 - 12:30 | 4034154 gmrpeabody
gmrpeabody's picture

Eric.., Eric.., he's our man

Send Eric Hold...., er.., oh wait.

Tue, 10/08/2013 - 12:47 | 4034242 Lewshine
Lewshine's picture

Why let a few facts get in the way of a good pillaging of the peasants?? Collectively, we are to ignorant and apathetic to have it any other way!

Tue, 10/08/2013 - 13:03 | 4034324 NotApplicable
NotApplicable's picture


Funny, as far as I know, only individuals have the capacity to be ignorant and/or apathetic enough to write such claims without regard for proper English.

Tue, 10/08/2013 - 13:19 | 4034411 Fish Gone Bad
Fish Gone Bad's picture

I am pretty sure he was writing poetically and well aware of the fact he was not expressing everyone's viewpoint.  I on the other hand am certainly guilty of expressing a great deal of angst.

Tue, 10/08/2013 - 13:01 | 4034308 Stoploss
Stoploss's picture

Well shit, so much for that plan.

I offered to run the SEC for free, for a week.

My plan was to call Nanex and give them access to everything they could think of that they might require i.e. crawl up the markets ass with an electron microscope, complete with perp walks and all the bell's and whistles.

No takers..

Make Nanex the SEC and give them a shotgun..............

Tue, 10/08/2013 - 12:21 | 4034118 SheepDog-One
SheepDog-One's picture

No need to worry...rest assured the SEC has PLENTY of chalk to draw the outline of everyones bankrupt corpse long after the robbers have escaped to Tahiti.

Tue, 10/08/2013 - 12:24 | 4034135 Zero Debt
Zero Debt's picture

Bloomberg had a story on this the other day -


Basically...once the "regulators" understand what is going on, then HFT will no longer be profitable.

Tue, 10/08/2013 - 12:27 | 4034141 SheepDog-One
SheepDog-One's picture

Sheesh....well how long will it take for 'the regulators' to finally figure out what's going on right under their nose all along for fucks sake?

Tue, 10/08/2013 - 13:27 | 4034430 Fish Gone Bad
Fish Gone Bad's picture

How long?  Well outcome based education does have some shortcomings...  I am not saying that they are retarded, I am just saying even the fat kids get trophies.

Tue, 10/08/2013 - 12:25 | 4034140 Manthong
Manthong's picture

Move Bart over to that office.

We can depend on him to get the job done.

Tue, 10/08/2013 - 12:29 | 4034150 Jannn
Jannn's picture

Mainland & Hong Kong Net Gold Import Jan-Aug 1154 Tons



Tue, 10/08/2013 - 12:35 | 4034156 Mercury
Mercury's picture

In other words, a high quote rate from any NYSE stock will cause a corresponding delay in all NYSE public quotes! Anyone with this knowledge can easily cause latency on demand.


Nice. A systemic, scalable opportunity for rent-seeking and fraud.  The bigger the numbers involved the easier it is to skim.


Reinternediation bitchez.


Tue, 10/08/2013 - 12:31 | 4034170 Hedgetard55
Hedgetard55's picture

I'm going all in on this FB dip.  :~)

Tue, 10/08/2013 - 12:47 | 4034234 Smartie37
Smartie37's picture

Silver Platter, meet Bumbling Boobs 

Bumbling Boobs, meet Silver Platter


Tue, 10/08/2013 - 12:51 | 4034247 Joebloinvestor
Joebloinvestor's picture

You have to rub their noses in shit to get them to admit they have their nose in something that is stinky.

Tue, 10/08/2013 - 12:52 | 4034257 maskone909
maskone909's picture




Tue, 10/08/2013 - 13:39 | 4034464 Clowns on Acid
Clowns on Acid's picture

Dear Tyler - We at the SEC will look into this right away. Then ask Goldman Sachs how we should respond.


Johnny "the Wad" Holmes

NY Regional Director - SEC

Tue, 10/08/2013 - 14:33 | 4034792 NaiLib
NaiLib's picture

Im impressed to see markets still buying. This is a mess.

Tue, 10/08/2013 - 14:50 | 4034888 withglee
withglee's picture

Why don't they (the order accepting process) add a random amount of time when time-stamping the order. Then send it to a sorted queue which releases in the (new) timestamp order. Some orders at random would release faster or slower than others. No one trader would have an advantage. This would put slow and fast traders on a level field and get rid of this HFT altogether. Such a plan would not limit the trading volume regardless of the mean of the time delay ... it could be seconds if need be. It would just shift the orders around within the time delay.

Do NOT follow this link or you will be banned from the site!