Hornady "Black and "Match" flyer problem?

[Old Marine]

After 80 black rounds and 20 match rounds of Hornady 6 arc ammo I am having issues while trying to shoot groups. I get 3 to 5  shots in under 1/2'' and then a flyer or two that is out 1'' to 2'' down or up. I am not perfect on the bench (who is?) and always call were I think a shot might be off to but never 1 to 2 inches at 100 yrds. If it is the rifle why are some so tite and some so far out? The powder is very dirty turning patches black with soot after one shot but if the soot causes the flyers why are some shots grouping small?
     I pulled a bullet and measured 30.2 grains of what (under 10x magnification) looks exactly like Hornady SuperFormance powder. I am confident that this load is compressed. My only answer is that the load is responsible.
     Is anyone shooting the factory ammo having similar results with flyers? If not the ammo what might be causing this?
     I am waiting for my FL Wilson die to arrive to see if my loads do the same as the factory loads. 
                                                                                                              Any thoughts?

[popgun]

A flyer opening up the group to an inch or so is common, but 2" is a lot. Maybe scope or mounts loose.

[Old Marine]

The factory base was loose now lock tighted. Still have flyers from the groups but now smaller- 1 inch.