Yes, you'll need to screen by debt/equity. If your brokerage doesn't have a good screener, Yahoo's is easy to use.
https://finance.yahoo.com/screenerYou can select specific REIT sub-industries and narrow the debt/equity to a range you are comfortable with.
That said, debt leverage is part of real estate investing and you might have a hard time finding REITs that have decided to turn down the opportunity to borrow at 3% in order to generate ROA at 5-10%. The candidates you find might have shaky earnings, which prevented them from borrowing as much as would be ideal. You might ask yourself why you are looking for low leverage. Is it to reduce volatility or because you anticipate rising rates? In either of these examples there would be better investments than REITs.
That said, nobody wants to buy a high-risk debt shell that will have a hard time servicing debt. I suggest screening by the "operating cash flow ratio" instead of debt/equity.
https://www.investopedia.com/terms/o/ocfratio.aspCalculating free cash flow over liabilities would be an ideal way to evaluate leverage IMO, but Yahoo doesn't offer that. Maybe your broker does?
Just be VERY careful about buying stocks that look good on a screener. Oftentimes the metrics are attractive because the stock market foresees reasons for the business to collapse. SPG probably looks healthy on paper, but do you really want to own malls in the era of Amazon and Covid 19? And of course I assume you already know not to screen REITs by earnings-based metrics like PE ratios. You have to like both the numbers and the company's strategy.