Since 2019, the world has been seriously impacted by the global pandemic, COVID-19, with millions of people adversely affected. This is coupled with a trend in which the intensity and frequency of natural disasters such as hurricanes, wildfires, and earthquakes have increased over the past decades. Larger and more diverse communities have been negatively influenced by these disasters and they might encounter crises socially and/or economically, further exacerbated when the natural disasters and pandemics co-occurred. However, conventional disaster response and management rely on human surveys and case studies to identify these in-crisis communities and their problems, which might not be effective and efficient due to the scale of the impacted population. In this paper, we propose to utilize the data-driven techniques and recent advances in artificial intelligence to automate the in-crisis community identification and improve its scalability and efficiency. Thus, immediate assistance to the in-crisis communities can be provided by society and timely disaster response and management can be achieved. A novel framework of the in-crisis community identification has been presented, which can be divided into three subtasks: (1) community detection, (2) in-crisis status detection, and (3) community demand and problem identification. Furthermore, the open issues and challenges toward automated in-crisis community identification are discussed to motivate future research and innovations in the area.