Are you driving on auto-gears ? Once I tried auto-gears on patch Y (what a shame) my FPS dropped very low, somewhere like 10-20, on drift server, all drift servers I enter makes my FPS low, seems funny but it's true, just start racing and it will be fine.