Reasons:
The huge cost.
Hub cities and main stops will prosper at the expense of smaller cities and towns.
Most people won’t be able to afford the tickets.
In a true sign of the times, the Economist mentions several countries with HSR plans but not the bumbling, ever-delayed, always more expensive plans for the proposed Los Angeles to San Francisco line.