Urban areas in Indonesia have the same characteristics with urban areas in developing countries. Some characteristics such as: (1) decreased of the function of nature with the reduced the number of natural green space or vegetation, (2) accumulation of roofed buildings in the area close to transportation access, industry and market, (3) the location of housing in the dangerous zone as close to the terminal, along the river side, along the railway lines, and the final waste disposal sites. The linkage between poverty index values with the physical morphology and vegetation of an area can be identified by the use of technology and remote sensing (RS). The accuracy of the analysis of poor housing with RS technology relies on the image quality of Very High Resolution (VHR) satellite and the completeness of the dataset Geographic Information Systems (GIS). Geo-spatial technologies are integrated as RS, GIS, and Global Positioning System (GPS) can contribute interactively in the assessment, understanding and mapping to solve the complex problem of residential in Indonesia.