Patterson hails from Delhi, Louisiana in Richland Parish.  His roots in horse racing can be traced to his Grandfather, J. E. Patterson Sr.  Patterson Sr. was a long-time trainer who spent his summers in the Boston area and winters racing at Fair Grounds in New Orleans.

Patterson began his career in racing in 1984 at Louisiana Downs.  His experience brought him to racetracks in Louisiana, Alabama, Oklahoma, Texas and Wyoming.  He served as racing secretary at Remington Park, Louisiana Downs and Lone Star Park.  In 2008, Patterson was recruited by the Louisiana Quarter Horse Breeders Association.  He served as their Executive Director from 2014 - 2019.  As Executive Director, Tony was instrumental in transitioning the LQHBA to an InCompass Solutions based system for its members and their breeder awards.

Patterson graduated from Louisiana Tech University with a B.S. in Business Administration.  He joined HISA in April of 2023 and is based out of Edmond, Oklahoma.