Under fairly general assumptions, we prove that every compact invariant set I of the semiflow generated by the semilinear damped wave equation u_{tt}+αu_t+β(x)u-\Deltau = f(x,u), (t,x)\in[0,+\infty[\timesΩ, u = 0, (t,x)\in[0,+\infty[\times\partialΩin H01(Ω)×L2(Ω)hasfiniteHausdorffandfractaldimension.HereΩisaregular,possiblyunbounded,domainin\R^3andf(x,u)isanonlinearityofcriticalgrowth.Thenonlinearityf(x,u)needsnottosatisfyanydissipativenessassumptionandtheinvariantsubset\mathcal Ineedsnottobeanattractor.Iff(x,u)isdissipativeand\mathcal Iistheglobalattractor,wegiveanexplicitboundontheHausdorffandfractaldimensionof\mathcal I$ in terms of the structure parameters of the equation.