Is the brick below the window above or below grade? If you have a brick foundation, that can be a tougher fix, but doable, but if it's a brick wall, it should just involve some mortar. If your brick is quite old you may need lime mortar, if you use modern stuff you'll kill the old brick in no time.