Люди помогите чайнику! FreeBSD поставил 2 недели назад. Сначала 8.1, сейчас 7.3.
У меня Intel MatrixRAID встроенный в мамку. Мать: DH57DD.В общем тестю RAID:
atacontrol status ar0ar0: ATA RAID1 status: READY
subdisks:
0 ad8 ONLINE
1 ad10 ONLINEatacontrol list
...
ATA channel 4:
Master: ad8 <ST3500418AS/CC46> SATA revision 2.x
Slave: no device present
ATA channel 5:
Master: ad10 <ST3500418AS/CC46> SATA revision 2.x
Slave: no device present
...atacontrol detach ata4
atacontrol attach ata4
atacontrol addspare ar0 ad8
atacontrol rebuild ar0
rebootВсе проходит на ура! А вот со вторым винтом...
atacontrol status ar0
ar0: ATA RAID1 status: READY
subdisks:
0 ad8 ONLINE
1 ad10 ONLINEatacontrol list
...
ATA channel 4:
Master: ad8 <ST3500418AS/CC46> SATA revision 2.x
Slave: no device present
ATA channel 5:
Master: ad10 <ST3500418AS/CC46> SATA revision 2.x
Slave: no device present
...atacontrol detach ata5
atacontrol attach ata5
atacontrol addspare ar0 ad10
atacontrol rebuild ar0Система после rebuild'а выдает:
ad8: WARNING - WRITE_DMA taskqueue timeout - completing request directly
ad8: WARNING - WRITE_DMA48 freeing taskqueue zombie request
ad10: WARNING - WRITE_DMA taskqueue timeout - completing request directly
ad10: WARNING - WRITE_DMA48 freeing taskqueue zombie requestdmesg
Copyright (c) 1992-2010 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.3-RELEASE #0: Sun Mar 21 06:15:01 UTC 2010
root@walker.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC i386
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Core(TM) i3 CPU 540 @ 3.07GHz (3066.81-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x20655 Stepping = 5
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x9ae3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,<b17>,SSE4.1,SSE4.2,POPCNT>
AMD Features=0x28100000<NX,RDTSCP,LM>
AMD Features2=0x1<LAHF>
TSC: P-state invariant
Cores per package: 8
Logical CPUs per core: 2
real memory = 3481174016 (3319 MB)
avail memory = 3400298496 (3242 MB)
ACPI APIC Table: <INTEL DH57DD >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP/HT): APIC ID: 1
cpu2 (AP): APIC ID: 4
cpu3 (AP/HT): APIC ID: 5
ioapic0: Changing APIC ID to 8
ioapic0 <Version 2.0> irqs 0-23 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
acpi0: <INTEL DH57DD> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
acpi_button0: <Sleep Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0x2000-0x207f mem 0xf2000000-0xf2ffffff,0xe0000000-0xefffffff,0xf0000000-0xf1ffffff irq 16 at device 0.0 on pci1
pci0: <simple comms> at device 22.0 (no driver attached)
atapci0: <Intel ATA controller> port 0x3070-0x3077,0x3084-0x3087,0x3068-0x306f,0x3080-0x3083,0x3040-0x304f irq 18 at device 22.2 on pci0
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
pci0: <simple comms, UART> at device 22.3 (no driver attached)
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xf3105c00-0xf3105fff irq 16 at device 26.0 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb0: waiting for BIOS to give up control
usb0: EHCI version 1.0
usb0: <EHCI (generic) USB 2.0 controller> on ehci0
usb0: USB revision 2.0
uhub0: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb0
uhub0: 3 ports with 3 removable, self powered
uhub1: <vendor 0x8087 product 0x0020, class 9/0, rev 2.00/0.00, addr 2> on uhub0
uhub1: single transaction translator
uhub1: 6 ports with 6 removable, self powered
ukbd0: <Logitech USB Receiver, class 0/0, rev 2.00/15.00, addr 3> on uhub1
kbd2 at ukbd0
ums0: <Logitech USB Receiver, class 0/0, rev 2.00/15.00, addr 3> on uhub1
ums0: 16 buttons and Z dir.
pci0: <multimedia, HDA> at device 27.0 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 28.4 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 28.6 on pci0
pci4: <ACPI PCI bus> on pcib4
ehci1: <EHCI (generic) USB 2.0 controller> mem 0xf3105800-0xf3105bff irq 23 at device 29.0 on pci0
ehci1: [GIANT-LOCKED]
ehci1: [ITHREAD]
usb1: waiting for BIOS to give up control
usb1: EHCI version 1.0
usb1: <EHCI (generic) USB 2.0 controller> on ehci1
usb1: USB revision 2.0
uhub2: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb1
uhub2: 3 ports with 3 removable, self powered
uhub3: <vendor 0x8087 product 0x0020, class 9/0, rev 2.00/0.00, addr 2> on uhub2
uhub3: single transaction translator
uhub3: 8 ports with 8 removable, self powered
pcib5: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci5: <ACPI PCI bus> on pcib5
vr0: <VIA VT6105 Rhine III 10/100BaseTX> port 0x1000-0x10ff mem 0xf3000000-0xf30000ff irq 21 at device 0.0 on pci5
vr0: Quirks: 0x0
vr0: Revision: 0x8b
miibus0: <MII bus> on vr0
ukphy0: <Generic IEEE 802.3u media interface> PHY 1 on miibus0
ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
vr0: Ethernet address: 00:19:5b:fd:81:4d
vr0: [ITHREAD]
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci1: <Intel ICH8 SATA300 controller> port 0x3058-0x305f,0x307c-0x307f,0x3050-0x3057,0x3078-0x307b,0x3020-0x303f mem 0xf3105000-0xf31057ff irq 19 at device 31.2 on pci0
atapci1: [ITHREAD]
atapci1: AHCI called from vendor specific driver
atapci1: AHCI Version 01.30 controller with 6 ports detected
ata4: <ATA channel 0> on atapci1
ata4: [ITHREAD]
ata5: <ATA channel 1> on atapci1
ata5: [ITHREAD]
ata6: <ATA channel 2> on atapci1
ata6: [ITHREAD]
ata7: <ATA channel 3> on atapci1
ata7: [ITHREAD]
ata8: <ATA channel 4> on atapci1
ata8: [ITHREAD]
ata9: <ATA channel 5> on atapci1
ata9: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
cpu0: <ACPI CPU> on acpi0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
cpu1: <ACPI CPU> on acpi0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
cpu2: <ACPI CPU> on acpi0
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
cpu3: <ACPI CPU> on acpi0
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
pmtimer0 on isa0
ata0 at port 0x1f0-0x1f7,0x3f6 irq 14 on isa0
ata0: [ITHREAD]
ata1 at port 0x170-0x177,0x376 irq 15 on isa0
ata1: [ITHREAD]
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
ppc0: parallel port not found.
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 8250 or not responding
sio0: [FILTER]
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ad8: 476940MB <Seagate ST3500418AS CC46> at ata4-master SATA300
ad10: 476940MB <Seagate ST3500418AS CC46> at ata5-master SATA300
acd0: DVDR <Optiarc DVD RW AD-5240S/1.03> at ata8-master SATA150
ar0: 476937MB <Intel MatrixRAID RAID1> status: READY
ar0: disk0 READY (master) using ad8 at ata4-master
ar0: disk1 READY (mirror) using ad10 at ata5-master
lapic5: Forcing LINT1 to edge trigger
SMP: AP CPU #3 Launched!
lapic1: Forcing LINT1 to edge trigger
SMP: AP CPU #1 Launched!
lapic4: Forcing LINT1 to edge trigger
SMP: AP CPU #2 Launched!
Trying to mount root from ufs:/dev/ar0s1a
ar0: WARNING - mirror protection lost. RAID1 array in DEGRADED mode
ata5: [ITHREAD]
ad10: 476940MB <Seagate ST3500418AS CC46> at ata5-master SATA300
ad10: inserted into ar0 disk1 as spare
ad8: WARNING - WRITE_DMA taskqueue timeout - completing request directly
ad8: WARNING - WRITE_DMA48 freeing taskqueue zombie request
ad10: WARNING - WRITE_DMA taskqueue timeout - completing request directly
ad10: WARNING - WRITE_DMA48 freeing taskqueue zombie requestНе могу понять в чем дело, после reboot'а:
atacontrol status ar0ar0: ATA RAID1 status: READY
subdisks:
0 ad8 ONLINE
1 ad10 ONLINEПомогите плс... Что это за ошибка и почему именно при тесте второго винта она появляется и как собственно ее убрать?
Перерыл весь Яндекс - нет ответа, может не там искал?
> atacontrol rebuild ar0
> rebootмежду этими двумя событиями сколько времени проходит?
>> atacontrol rebuild ar0
>> reboot
> между этими двумя событиями сколько времени проходит?Это в не зависимости от времени! Пробовал комп включить - протестить ad8. Все ок. Выключить! Через час включить - протестить ad10. Ошибки.
Пробовал уже версию с 8.1 на 7.3 менять.
>>> atacontrol rebuild ar0
>>> reboot
>> между этими двумя событиями сколько времени проходит?
> Это в не зависимости от времени! Пробовал комп включить - протестить ad8.
> Все ок. Выключить! Через час включить - протестить ad10. Ошибки.
> Пробовал уже версию с 8.1 на 7.3 менять.просто ответьте на вопрос, какое время?
переведу с эзопового:
команда
atacontrol rebuild ar0
моментально возвращает управление, запустив процесс синхронизации
если reboot произведен до завершения этого процесса, результат очевиден
> просто ответьте на вопрос, какое время?
> переведу с эзопового:
> команда
> atacontrol rebuild ar0
> моментально возвращает управление, запустив процесс синхронизации
> если reboot произведен до завершения этого процесса, результат очевиденИзвиняюсь непонял вопроса сначала.
atacontrol rebuild ar0
Потом конечно я отслеживаю завершение rebuild'а через:
atacontrol status ar0
Когда процесс заканчивается, тогда делаю reboot. Примерно час.
а смарты винтов не смотрели? может все гораздо банальнее ... ?
> а смарты винтов не смотрели? может все гораздо банальнее ... ?По моему все ок, но я начинающий, может чего-то не узрел.
Вот:
localhost# smartctl -a /dev/ad8
smartctl 5.40 2010-10-16 r3189 [FreeBSD 7.3-RELEASE i386] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.12 family
Device Model: ST3500418AS
Serial Number: 9VMS9SX5
Firmware Version: CC46
User Capacity: 500,107,862,016 bytes
Device is: In smartctl database [for details use: -P show]
ATA Version is: 8
ATA Standard is: ATA-8-ACS revision 4
Local Time is: Sat Jan 15 10:38:15 2011 VLAT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSEDGeneral SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 600) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 85) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x103f) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 107 100 006 Pre-fail Always - 12633123
3 Spin_Up_Time 0x0003 097 097 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 34
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 100 253 030 Pre-fail Always - 132643
9 Power_On_Hours 0x0032 100 100 000 Old_age Always - 40
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 17
183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 073 053 045 Old_age Always - 27 (Min/Max 20/32)
194 Temperature_Celsius 0x0022 027 047 000 Old_age Always - 27 (0 20 0 0)
195 Hardware_ECC_Recovered 0x001a 032 031 000 Old_age Always - 12633123
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 30245159698497
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 989494798
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 3712462348SMART Error Log Version: 1
No Errors LoggedSMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.localhost# smartctl -a /dev/ad10
smartctl 5.40 2010-10-16 r3189 [FreeBSD 7.3-RELEASE i386] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.12 family
Device Model: ST3500418AS
Serial Number: 9VMS9W29
Firmware Version: CC46
User Capacity: 500,107,862,016 bytes
Device is: In smartctl database [for details use: -P show]
ATA Version is: 8
ATA Standard is: ATA-8-ACS revision 4
Local Time is: Sat Jan 15 10:41:08 2011 VLAT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSEDGeneral SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 600) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 85) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x103f) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 107 100 006 Pre-fail Always - 13323795
3 Spin_Up_Time 0x0003 097 097 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 34
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 100 253 030 Pre-fail Always - 202750
9 Power_On_Hours 0x0032 100 100 000 Old_age Always - 40
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 17
183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 073 052 045 Old_age Always - 27 (Min/Max 20/31)
194 Temperature_Celsius 0x0022 027 048 000 Old_age Always - 27 (0 20 0 0)
195 Hardware_ECC_Recovered 0x001a 029 025 000 Old_age Always - 13323795
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 87952340287572
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 600480205
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 2630120020SMART Error Log Version: 1
No Errors LoggedSMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.localhost# smartctl -a /dev/ar0
smartctl 5.40 2010-10-16 r3189 [FreeBSD 7.3-RELEASE i386] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net/dev/ar0: Unable to detect device type
Smartctl: please specify device type with the -d option.Use smartctl -h to get a usage summary
Я в инете прочитал, что этот WARING это вроде что то с буфером.
ad8: WARNING - WRITE_DMA taskqueue timeout - completing request directly
ad8: WARNING - WRITE_DMA48 freeing taskqueue zombie request
ad10: WARNING - WRITE_DMA taskqueue timeout - completing request directly
ad10: WARNING - WRITE_DMA48 freeing taskqueue zombie request
А что эта ошибка озночает?
Выкиньте Intel Matrix и используйте встроенный gmirror, и еще проверьте кабелечек SATA.
http://www.opennet.me/openforum/vsluhforumID15/3419.html